-- Logs begin at Thu 2022-07-21 16:51:02 UTC, end at Thu 2022-07-21 18:26:28 UTC. -- Jul 21 17:25:12.073857 dv-cinder-825492-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 17:25:12.082458 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 17:25:12.084476 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 17:25:12 2022] *** Jul 21 17:25:12.084476 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 17:25:12.084476 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 17:25:12.084476 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: nodename: dv-cinder-825492-27-iscsi Jul 21 17:25:12.084476 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: machine: x86_64 Jul 21 17:25:12.084476 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: clock source: unix Jul 21 17:25:12.084476 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: pcre jit disabled Jul 21 17:25:12.084476 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: detected number of CPU cores: 4 Jul 21 17:25:12.084476 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: current working directory: / Jul 21 17:25:12.084476 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: detected binary path: /usr/bin/uwsgi-core Jul 21 17:25:12.085167 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: your processes number limit is 47680 Jul 21 17:25:12.085167 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: your memory page size is 4096 bytes Jul 21 17:25:12.085167 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: detected max file descriptor number: 2048 Jul 21 17:25:12.085167 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: lock engine: pthread robust mutexes Jul 21 17:25:12.085167 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: thunder lock: enabled Jul 21 17:25:12.085167 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 17:25:12.085167 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 17:25:12.128276 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: Python main interpreter initialized at 0x55736194e9c0 Jul 21 17:25:12.128276 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: python threads support enabled Jul 21 17:25:12.128276 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: your server socket listen backlog is limited to 100 connections Jul 21 17:25:12.128276 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: your mercy for graceful operations on workers is 90 seconds Jul 21 17:25:12.128625 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 17:25:12.128698 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: *** Operational MODE: preforking *** Jul 21 17:25:12.128949 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: *** uWSGI is running in multiple interpreter mode *** Jul 21 17:25:12.128949 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: spawned uWSGI master process (pid: 103407) Jul 21 17:25:12.129132 dv-cinder-825492-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 17:25:12.131985 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: spawned uWSGI worker 1 (pid: 103408, cores: 1) Jul 21 17:25:12.131985 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: spawned uWSGI worker 2 (pid: 103409, cores: 1) Jul 21 17:25:12.131985 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 17:25:12.790540 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 17:25:12.811928 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 17:25:13.913175 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 17:25:13.913175 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: from cryptography.utils import int_from_bytes Jul 21 17:25:13.913789 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 17:25:13.913789 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: from cryptography.utils import int_from_bytes Jul 21 17:25:13.942908 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 17:25:13.942908 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: from cryptography.utils import int_from_bytes Jul 21 17:25:13.943414 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 17:25:13.943414 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: from cryptography.utils import int_from_bytes Jul 21 17:25:16.412594 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 17:25:16.413179 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 17:25:16.413280 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 17:25:16.413280 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 17:25:16.413693 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 17:25:16.413693 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 17:25:16.413836 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 17:25:16.414116 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 17:25:16.414228 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 17:25:16.414309 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 17:25:16.414392 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.414629 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.414731 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.414945 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.415040 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.415257 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.415344 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.415583 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.415670 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.415890 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.415974 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.416802 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.416909 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.417127 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.417304 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.417448 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.417644 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.417781 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.417907 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.418042 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.418221 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.418358 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.418544 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-27-iscsi {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.418685 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-27-iscsi {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.418866 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.419008 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.419170 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.419316 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.419479 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.419627 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.419796 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.419947 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.420099 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.420254 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.420444 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.420603 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.420748 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.420909 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.421247 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.421647 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.421804 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.421919 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.422022 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.422125 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.422272 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.422385 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.422607 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.422691 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.422919 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.423047 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.423228 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.423315 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.423549 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.423635 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.423855 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.423944 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.424175 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.424342 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.424508 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.424635 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.424922 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-27-iscsi {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.425066 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-27-iscsi {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.425227 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.425314 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.425552 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.425665 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.425843 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.425928 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.426253 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.426355 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.426561 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.426648 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.426871 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.426976 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.427188 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.427288 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.427508 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.427593 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.427812 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.427898 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.428138 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.428233 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.428482 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.428570 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.428799 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.428885 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.429119 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.429207 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.429419 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.429512 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.429723 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.429808 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.430025 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.430112 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.430342 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.430435 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.430642 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.430736 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.430945 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.431031 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.431193 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.431287 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.431501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.431651 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.432042 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.432130 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.432240 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.432438 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.432530 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.432627 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.432749 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.432857 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.432966 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.433052 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.433287 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.433377 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.433604 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.433688 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.433909 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.433992 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.434213 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.434297 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.434516 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.434599 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.434817 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.434909 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.435121 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.435208 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.435424 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.435507 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.435726 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.435821 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.436026 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.436117 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.436365 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.436465 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.436679 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.436777 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.437000 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.437089 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.437303 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.437387 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.437624 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.437724 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.438017 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.438107 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.438267 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.438365 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.438571 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.438665 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.438907 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.438990 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.439225 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.439309 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.439531 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.439617 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.439849 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.439933 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.440166 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.440249 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.440495 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.440582 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.440799 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.440889 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.441101 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.441185 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.441720 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.441816 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.442011 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.442096 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.442313 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.442395 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.442558 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.442652 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.442854 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.442939 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.443155 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.443293 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.443470 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.443554 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.443772 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.443870 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.444073 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.444167 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.444396 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.444484 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.444693 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.444778 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.444995 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.445088 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.445296 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.445383 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.445597 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.445680 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.445899 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.445997 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.446199 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.446284 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.446499 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.446592 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.446801 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.446905 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.447101 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.447194 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.447427 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.447525 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.447747 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.447870 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.448159 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.448245 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.448494 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.448581 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.448803 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.448889 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.449109 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.449203 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.449416 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.449500 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.449732 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.449893 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.450036 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.450127 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.450337 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.450420 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.450655 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.450748 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.450956 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.451039 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.451258 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.451343 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.451574 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.451665 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.451879 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.451963 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.452183 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.452265 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.452521 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.452608 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.452821 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.452904 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.453122 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.453205 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.453439 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.453531 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.453743 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.453844 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.454045 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.454128 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.454346 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.454430 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.454647 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.454731 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.454949 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.455040 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.455249 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.455332 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.455548 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.455631 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.455846 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.455938 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.456144 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.456227 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.456483 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.456579 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.456805 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.456897 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.457110 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.457192 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.457414 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.457498 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.457716 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.457808 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.458034 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.458116 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:25:16.458366 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.458460 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.458701 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.458821 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.459041 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.459132 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.459353 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.459442 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.459686 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.459775 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.460015 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.460102 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.460357 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.460516 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.460664 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.460798 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.460967 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.461102 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.461294 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.461429 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.461602 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.461741 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.461911 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.462042 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.462220 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.462356 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.462533 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.462661 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.462847 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.463668 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.463767 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.463877 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.464104 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.464235 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.464418 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.464554 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.464711 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.464854 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.464987 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.465118 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.465251 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.465338 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.465573 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.465711 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.465896 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.466025 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.466208 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.466337 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.466550 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.466709 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.466897 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.467028 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.467212 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.467352 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.467539 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.467671 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.467859 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.467987 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.468170 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.468328 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.468506 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.468640 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.468817 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.468951 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.469138 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.469280 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.469466 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.469602 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.469778 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.469909 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.470094 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.470227 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.470406 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.470539 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.470715 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.470860 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.471022 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.471168 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.471334 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.471476 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.471642 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.471775 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.471978 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.472124 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.472306 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.472395 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.472628 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.472712 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.472938 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.473107 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.473255 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.473347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.473564 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.473695 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.473873 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.473968 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.474183 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.474274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.474482 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.474567 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.474786 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.474918 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.475090 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.475175 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.475396 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.475517 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.475699 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.475793 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.476017 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.476100 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.476362 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.476451 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.476670 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.476756 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.477001 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.477085 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.477311 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.477402 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.477618 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.477710 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.477927 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.478011 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.478235 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.478321 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.478564 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.479211 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.479489 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.479613 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.479800 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.479970 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.480105 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.480289 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.480455 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.480643 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.480765 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.480961 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.481070 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.481272 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.481389 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.481599 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.481686 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.481911 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.482004 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.482224 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.482310 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.482542 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.482636 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.482858 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.482945 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.483172 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.483264 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.483480 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.483573 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.483793 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.483878 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.484102 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.484186 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.484437 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.484544 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.484749 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.484843 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.485085 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.485169 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.485391 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.485486 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.485712 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.485799 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.486035 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.486120 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.486350 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.486456 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.486655 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.486741 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.486962 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.487053 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.487271 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.487363 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.487575 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.487660 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.487880 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.487963 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.488186 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.488335 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.488515 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.488601 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.488819 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.488904 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.489123 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.489216 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.489428 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.489523 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.489731 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.489815 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.490035 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.490120 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.490348 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.490432 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.490652 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.490746 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.490955 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.491041 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.491256 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.491348 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.491560 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.491657 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.491889 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.491974 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.492205 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.492397 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.492575 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.492671 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.492890 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.492974 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.493212 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.493298 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.493523 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.493626 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.493838 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.493928 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.494147 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.494233 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.494494 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.494590 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.494804 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.494995 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.495134 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.495313 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.495454 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.495637 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.495783 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.495960 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.496089 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.496277 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.496440 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.496622 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.496752 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.496938 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.497068 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.497270 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.497409 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.497586 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.497737 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.497907 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.498036 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.498215 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.498358 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.498534 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.498664 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.498868 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.498996 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.499192 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.499327 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.499502 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.499643 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.499816 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.499957 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.500124 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.500270 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.500461 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.500562 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.500769 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.500862 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.501079 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.501165 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.501388 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.501472 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.501694 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.501837 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.502010 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.502103 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.502319 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.502447 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.502636 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.502798 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.502942 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.503026 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.503257 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.503345 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.503562 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.503656 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.503875 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.503960 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.504180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.504263 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.504535 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.504678 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.504846 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.504930 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.505157 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.505251 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.505478 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.505571 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.505791 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.505874 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.506098 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.506188 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.506408 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.506494 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.506713 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.506807 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.507022 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.507106 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.507326 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.507411 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.507636 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.507720 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.507943 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.508027 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.508254 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.508368 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.508585 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.508672 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.508896 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.508980 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.509205 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.509290 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.509510 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.509596 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.509841 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.509938 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.510157 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.510280 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.510480 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.510568 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.510790 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.510889 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.511112 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.511205 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.511424 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.511508 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.511727 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.511824 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.512030 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.512116 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.512374 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.512497 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.512687 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.512780 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.512988 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.513079 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.513290 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.513382 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.513593 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.513694 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.513905 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.513989 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.514230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.514360 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.514522 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.514616 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.514837 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.514925 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.515155 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.515241 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.515462 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.515548 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.515774 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.515858 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.516086 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.516173 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.516414 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.516502 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.516738 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.516821 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.517051 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.517138 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.517357 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.517449 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.517664 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.517750 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.517973 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.518066 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.518280 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.518366 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.518586 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.518671 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.518894 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.518986 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.519202 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.519286 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.519508 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.519592 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.519814 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.519910 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.520117 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.520211 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.520449 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.520538 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.520760 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.520856 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.521071 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.521327 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.521420 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.521660 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.521946 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.522031 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.522276 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.522359 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.522592 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.522676 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.522907 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.522998 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.523225 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.523310 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.523548 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.523633 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.523883 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.523969 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.524185 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.524278 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.524522 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.524624 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.524829 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.524923 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.525132 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.525219 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.525985 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.526114 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.526331 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.526454 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.526597 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.526728 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.526904 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.527040 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.527209 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.527354 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.527515 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.527665 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.527812 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.527970 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.528118 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.528275 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.528440 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.528603 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.528737 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.528917 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.529044 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.529221 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.529358 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.529531 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.529664 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.529834 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.529975 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.530157 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.530281 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.530464 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.530605 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.530767 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.530916 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.531067 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.531221 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.531368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.531524 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.531707 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.531827 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.532012 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.532169 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.532370 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.532512 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.532702 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.532853 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.533044 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.533187 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.533350 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.533531 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.533654 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.533840 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.533977 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.534148 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.534279 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.534475 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.534583 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.534782 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.534868 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.535089 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.535185 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.535396 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.535493 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.535706 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.535792 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.536017 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.536108 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.536342 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.536442 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.536656 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.536742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.536968 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.537052 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.537266 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.537359 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.537578 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.537663 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.537878 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.537961 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.538186 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.538280 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.538491 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.538574 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.538792 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.538876 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.539093 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.539178 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.539397 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.539480 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.539699 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.539784 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.539999 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.540084 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.540341 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.540441 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.540632 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.540716 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.540943 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.541728 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.542091 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.542221 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.542312 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.542398 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.542486 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.542564 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.542718 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.542846 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.543020 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.543114 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.543323 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.543411 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.543632 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.543722 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.543937 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.544030 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.544237 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.544342 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.544565 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.544659 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.544872 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.544966 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.545175 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.545314 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.545476 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.545606 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.545778 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.545915 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.546083 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.546211 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.546394 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.546525 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.546694 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.546842 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.547003 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.547134 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.547306 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.547474 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.547610 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.547741 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.547905 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.548036 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.548209 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.548392 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.548535 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.548667 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.548808 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.548952 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.549094 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.549228 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.549400 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.549529 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.549705 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.549842 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.550009 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.550154 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.550319 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.550448 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.550620 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.550763 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.550923 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.551065 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.551225 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.551365 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.551535 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.551667 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.551839 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.551977 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.552184 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.552342 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.552520 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.552657 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.552833 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.552979 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.553147 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.553233 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.553457 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.553542 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.553766 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.553859 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.554076 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.554168 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.554380 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.554465 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.554693 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.554779 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.554999 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.555083 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.555307 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.555391 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.555612 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.555699 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.555914 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.556000 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.556218 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.556328 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.556550 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.556656 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.556881 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.556964 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.557203 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.557288 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.557532 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.557618 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.557857 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.557955 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.558161 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.558255 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.558477 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.558583 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.558781 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.558925 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.559090 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.559211 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.559397 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.559495 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.559704 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.559809 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.560012 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.560124 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.560339 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.560443 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.560651 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.560737 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.560959 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.561052 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.561267 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.561356 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.561571 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.561657 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.561880 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.561965 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.562184 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.562268 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.562487 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.562571 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.562798 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.562890 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.563105 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.563242 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.563406 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.563534 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.563711 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.563846 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.564012 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.564154 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.564337 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.564472 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.564628 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.564759 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.564941 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.565082 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.565250 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.565392 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.565647 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.565783 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.565949 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.566090 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.566254 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.566655 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.566823 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.566963 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.567134 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.567265 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.567445 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.567581 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.567747 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.567876 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.568067 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.568200 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.568399 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.568542 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.568784 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.568928 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.569081 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.569206 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.569383 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.569514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.569683 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.569813 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.569990 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.570119 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.570304 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.570431 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.570604 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.570737 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.570907 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.571037 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.571208 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.571343 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.571515 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.571647 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.571816 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.571947 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.572135 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.572286 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.572595 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.572738 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.572906 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.573054 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.573210 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.573408 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.573624 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.573709 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.573935 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.574029 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.574239 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.574432 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.574561 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.574751 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.574880 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.575067 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.575202 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.575396 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.575530 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.575723 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.575853 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.576051 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.576194 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.576383 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.576517 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.576700 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.576832 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.577014 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.577100 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.577337 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.577422 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.577643 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.577729 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.577963 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.578047 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.578280 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.578366 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.578588 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.578673 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.578907 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.579000 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.579232 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.579324 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.579550 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.579635 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.579877 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.579970 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.580230 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.580334 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.580589 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.580675 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.580895 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.580993 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.581199 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.581292 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.581507 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.581593 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.581809 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.581895 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.582110 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.582195 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.582432 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.582517 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.582736 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.582822 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.583040 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.583124 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.583345 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.583432 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.583650 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.583745 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.583953 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.584038 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.584257 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.584391 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.584592 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.584678 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.584893 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.584977 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.585198 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.585292 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.585511 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.585647 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.585818 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.585946 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.586140 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.586282 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.586445 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.586580 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.586769 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.586915 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.587076 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.587224 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.587385 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.587516 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.587687 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.587821 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.588536 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.588659 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.588888 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.589129 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.589252 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.589448 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.589556 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.589771 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.589867 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.590106 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.590195 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.590427 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.590523 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.590738 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.590825 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.591072 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.591160 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.591383 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.591478 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.591699 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.591786 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.592016 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.592105 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.592358 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.592464 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.592666 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.592761 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.592971 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.593060 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.593283 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.593429 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.593586 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.593719 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.593889 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.594033 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.594176 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.594314 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.594480 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.594609 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.594778 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.594918 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.595082 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.595217 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.595384 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.595518 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.595686 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.595824 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.595991 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.596126 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.596334 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.596438 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.596641 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.596779 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.596945 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.597093 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.597237 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.597371 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.597536 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.597679 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.597852 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.597988 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.598155 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.598309 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.598491 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.598629 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.598796 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.598924 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.599115 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.599250 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.599437 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.599578 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.599746 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.599875 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.600068 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.600203 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.600401 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.600535 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.600714 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.600854 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.601028 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.601158 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.601340 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.601470 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.601652 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.601791 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.601964 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.602100 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.602274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.602415 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.602581 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.602724 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.602893 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.603027 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.603191 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.603320 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.603504 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.603690 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.604407 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.604709 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.604919 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.605155 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.605285 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.605478 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.605616 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.605799 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.605930 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.606117 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.606247 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.606435 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.606575 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.606748 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.606880 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.607063 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.607200 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.607375 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.607506 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.607687 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.607817 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.607998 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.608133 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.608323 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.608478 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.608657 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.608744 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.608982 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.609067 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.609312 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.609410 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.609626 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.609773 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.609939 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.610071 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.610252 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.610384 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.610564 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.610694 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.610880 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.611010 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.611217 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.611351 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.611525 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.611655 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.611832 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.612044 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.612179 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.612340 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.612472 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.612606 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.612763 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.612904 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.613073 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.613207 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.613386 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.613528 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.613696 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.613844 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.614007 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.614140 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.614315 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.614467 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.614610 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.614745 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.614925 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.615064 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.615234 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.615367 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.615561 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.615697 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.615879 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.616008 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.616194 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.616353 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.616529 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.616671 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.616843 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.616976 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.617159 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.617362 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.617680 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.617820 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.617995 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.618124 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.618330 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.618474 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.618656 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.618792 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.618971 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.619100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.619319 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.619460 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.619638 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.619857 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.619995 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.620177 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.620335 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.620517 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.620650 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.620835 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.620967 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.621151 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.621290 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.621459 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.621603 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.621783 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.621912 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.622096 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.622235 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.622401 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.622539 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.622721 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.622853 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.623029 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.623169 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.623562 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.623699 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.623905 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.624043 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.624222 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.624403 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.624577 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.624735 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.624903 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.625038 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.625223 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.625356 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.625530 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.625660 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.625857 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.625988 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.626167 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.626299 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.626473 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.626609 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.626791 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.626921 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.627099 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.627236 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.627434 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.627563 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.627693 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.627822 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.628001 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.628132 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.628319 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.628453 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.628635 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.628769 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.628939 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.629044 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.629243 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.629335 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.629566 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.629699 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.629877 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.629975 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.630181 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.630268 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.630487 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.630585 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.630796 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.630884 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.631102 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.631190 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.631406 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.631504 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.631712 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.631799 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.632016 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.632102 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.632344 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.632437 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.632651 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.632745 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.632961 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.633061 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.633267 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.633356 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.633576 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.633665 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.633882 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.633968 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.634190 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.634278 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.634537 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.634639 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.634901 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.635017 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.635201 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.635291 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.635606 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.635693 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.635930 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.636098 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.636237 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.636387 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.636584 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.636725 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.636895 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.637042 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.637204 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.637346 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.637552 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.637687 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.637872 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.638015 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.638408 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.638542 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.638744 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.638875 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.639061 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.639212 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.639392 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.639527 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.639723 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.639937 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.640085 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.640218 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.640422 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.640557 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.640683 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.640816 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.640962 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.641104 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.641237 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.641378 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.641542 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.641650 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.641854 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.641985 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.642152 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.642284 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.642460 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.642598 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.642769 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.642898 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.643076 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.643211 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.643381 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.643518 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.643687 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.643822 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.643996 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.644130 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.644316 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.644459 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.644631 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.644762 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.644939 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.645074 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.645251 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.645383 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.645591 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.645723 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.645907 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.646044 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.646221 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.646355 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.646537 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.646669 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.646850 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.646991 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.647160 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.647298 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.647468 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.647601 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.647768 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.647897 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.648073 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.648213 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.648410 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.648542 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.648741 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.648891 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.649054 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.649141 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.649358 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.649445 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.649774 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.649870 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.650085 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.650183 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.651068 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.651174 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.651263 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.651353 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.651574 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.651660 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.651901 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.651986 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.652231 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.652338 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.652577 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.652663 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.652903 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.652988 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.653212 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.653299 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.653542 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.653629 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.653880 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.653966 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.654211 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.654297 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.654533 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.654627 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.654839 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.654938 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.655145 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.655231 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.655448 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.655535 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.655756 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.655856 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.656071 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.656198 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.656403 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.656491 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.656706 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.656804 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.657006 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.657092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.657314 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.657399 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.657617 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.657714 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.657916 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.658002 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.658218 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.658304 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.658521 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.658651 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.658837 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.658959 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.659126 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.659211 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.659428 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.659515 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.659729 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.659815 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.660030 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.660130 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.660352 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.660464 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.660653 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.660741 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.660958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.661052 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.661258 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.661346 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.661558 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.661644 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.661860 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.661953 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.662158 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.662303 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.662460 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.662548 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.662834 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.662936 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.663121 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.663214 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.663435 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.663528 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.663757 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.663855 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.664066 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.664159 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.664410 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.664499 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.664721 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.664809 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.665043 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.665130 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.665363 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.665449 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.665673 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.665766 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.665979 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.666118 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.666362 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.666451 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.666677 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.666765 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.666986 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.667077 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.667295 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.667381 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.667603 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.667690 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.667912 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.667998 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.668221 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.668345 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.668558 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.668644 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.668880 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.668965 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.669185 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.669283 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.669511 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.669596 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.669823 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.669909 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.670137 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.670230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.670454 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.670551 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.670759 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.670850 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.671089 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.671184 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.671395 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.671481 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.671702 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.671787 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.672008 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.672108 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.672328 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.672462 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.672641 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.672727 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.672951 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.673039 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.673258 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.673343 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.673565 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.673659 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.673875 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.673960 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.674187 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.674272 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.674512 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.674661 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.674837 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.674967 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.675143 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.675231 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.675468 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.675567 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.675793 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.675880 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.676138 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.676222 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.676469 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.676569 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.676808 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.676894 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.677136 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.677230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.677449 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.677536 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.677758 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.677843 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.678065 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.678155 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:25:16.678310 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 17:25:16.678397 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 17:25:16.741323 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO dbcounter [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] Registered counter for database nova_api Jul 21 17:25:16.741861 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Registered counter for database nova_api Jul 21 17:25:16.854864 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG oslo_db.sqlalchemy.engines [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:25:16.857266 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:25:16.861165 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writer thread running {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:25:16.863770 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:25:16.917583 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.context [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d906d140-42ad-4012-a7e5-1433e18e34ea(cell1) {{(pid=103409) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 17:25:16.920819 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.context [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d906d140-42ad-4012-a7e5-1433e18e34ea(cell1) {{(pid=103408) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 17:25:16.921481 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:25:16.923070 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:25:16.923852 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:25:16.924799 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:25:16.926005 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:25:16.926383 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:25:16.927176 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:25:16.927966 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO dbcounter [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] Registered counter for database nova_cell0 Jul 21 17:25:16.929315 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:25:16.931402 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Registered counter for database nova_cell0 Jul 21 17:25:16.932959 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO dbcounter [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] Registered counter for database nova_cell1 Jul 21 17:25:16.935929 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Registered counter for database nova_cell1 Jul 21 17:25:16.940075 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG oslo_db.sqlalchemy.engines [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:25:16.942658 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG oslo_db.sqlalchemy.engines [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:25:16.944208 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:25:16.946491 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:25:16.948796 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writer thread running {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:25:16.953242 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:25:16.953542 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writer thread running {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:25:16.955673 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:25:17.095452 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO dbcounter [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] Registered counter for database nova_cell0 Jul 21 17:25:17.101830 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Registered counter for database nova_cell0 Jul 21 17:25:17.102124 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG oslo_db.sqlalchemy.engines [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:25:17.107056 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writer thread running {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:25:17.111425 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:25:17.115641 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:25:17.444697 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 17:25:17.451989 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 17:25:17.452122 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: WARNING keystonemiddleware.auth_token [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 17:25:17.459356 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: WARNING keystonemiddleware.auth_token [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 17:25:17.790556 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 17:25:17.797319 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 17:25:17.802542 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55736194e9c0 pid: 103408 (default app) Jul 21 17:25:17.804620 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:25:17.805807 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Jul 21 17:25:17.806210 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Thu Jul 21 17:25:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:25:17.810777 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: WARNING keystonemiddleware.auth_token [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 17:25:17.817037 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: WARNING keystonemiddleware.auth_token [None req-ac4d6b49-8811-4bbb-963d-248d7ba85bf9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 17:25:17.822367 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55736194e9c0 pid: 103409 (default app) Jul 21 17:26:33.957194 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:26:33.958832 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 Jul 21 17:26:33.959222 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:26:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:26:33.971761 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_api:SELECT=3 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:26:33.972976 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_cell1:SELECT=3 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:26:33.973887 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_cell0:SELECT=3 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:26:33.975141 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:26:34.826550 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-30904f4b-6bcb-49a1-8ae1-2087ca57e1b8 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:26:34.858532 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-30904f4b-6bcb-49a1-8ae1-2087ca57e1b8 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.892569 Jul 21 17:26:34.859326 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jul 21 17:26:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:26:37.120628 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:26:37.122286 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-3934444e-0212-4ce5-9797-66948b30c133 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003129 Jul 21 17:26:37.123009 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:26:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:26:37.633106 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-adab7cfb-13df-4751-812d-1673989fc40b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:37.651826 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 17:26:37.651826 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: warnings.warn(msg) Jul 21 17:26:37.684881 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-adab7cfb-13df-4751-812d-1673989fc40b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.553622 Jul 21 17:26:37.685639 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 17:26:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:26:37.913116 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-18785755-7130-438f-95d4-87f6621c3d01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:37.917251 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 17:26:37.917251 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 21 17:26:37.935367 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=3 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:26:37.936040 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell0:SELECT=3 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:26:37.936731 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell1:SELECT=3 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:26:37.937579 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:26:37.981387 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-18785755-7130-438f-95d4-87f6621c3d01 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286866 Jul 21 17:26:37.981996 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jul 21 17:26:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:26:40.260501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-adab7cfb-13df-4751-812d-1673989fc40b admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:26:40.261531 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-adab7cfb-13df-4751-812d-1673989fc40b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jul 21 17:26:40.261936 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:26:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:26:40.934856 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-12324ec6-fe7f-4249-a538-a15bb16e2165 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "swap": 0}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:40.954404 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 17:26:40.954404 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 21 17:26:40.975011 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-12324ec6-fe7f-4249-a538-a15bb16e2165 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.707031 Jul 21 17:26:40.981359 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 17:26:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:26:40.987814 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-fa1607be-4ebc-4f08-86c8-69c2e6f06f73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:40.990120 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 17:26:40.990120 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: warnings.warn(msg) Jul 21 17:26:41.025073 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-fa1607be-4ebc-4f08-86c8-69c2e6f06f73 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040995 Jul 21 17:26:41.025872 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jul 21 17:26:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:26:43.276994 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-12324ec6-fe7f-4249-a538-a15bb16e2165 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:26:43.278404 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-12324ec6-fe7f-4249-a538-a15bb16e2165 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jul 21 17:26:43.278404 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:26:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:26:43.679435 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-211a321e-f950-4cb6-a452-cbe575700bac admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "disk": 10, "vcpus": 1}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:43.697413 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-211a321e-f950-4cb6-a452-cbe575700bac admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.413253 Jul 21 17:26:43.698157 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 17:26:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:26:43.710916 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-775af892-261d-4321-ba97-ef646431e4a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:43.732758 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-775af892-261d-4321-ba97-ef646431e4a0 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026510 Jul 21 17:26:43.733393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jul 21 17:26:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:26:46.037569 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-211a321e-f950-4cb6-a452-cbe575700bac admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:26:46.039242 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-211a321e-f950-4cb6-a452-cbe575700bac admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Jul 21 17:26:46.039654 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:26:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:26:46.462481 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-346a3ac6-5dad-4811-9a1f-f084cc1fe7b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "ram": 2048, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:46.483582 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-346a3ac6-5dad-4811-9a1f-f084cc1fe7b5 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437694 Jul 21 17:26:46.484246 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 17:26:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 17:26:46.499494 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-0b64aa9b-2000-4f75-a3e4-3a0a03c0358e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:46.536636 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-0b64aa9b-2000-4f75-a3e4-3a0a03c0358e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042059 Jul 21 17:26:46.544321 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jul 21 17:26:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:26:48.819516 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-346a3ac6-5dad-4811-9a1f-f084cc1fe7b5 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:26:48.820546 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-346a3ac6-5dad-4811-9a1f-f084cc1fe7b5 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 21 17:26:48.820963 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:26:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:26:49.266159 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-8d1cd67e-7e44-4e0a-b053-6df576b8a925 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:49.283736 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-8d1cd67e-7e44-4e0a-b053-6df576b8a925 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456776 Jul 21 17:26:49.284850 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 17:26:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 17:26:49.296899 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-aaa00eae-51e5-40f6-aebf-e5d928754812 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:49.321877 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-aaa00eae-51e5-40f6-aebf-e5d928754812 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028512 Jul 21 17:26:49.322529 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jul 21 17:26:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:26:51.832287 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-8d1cd67e-7e44-4e0a-b053-6df576b8a925 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:26:51.833314 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-8d1cd67e-7e44-4e0a-b053-6df576b8a925 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Jul 21 17:26:51.833725 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:26:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:26:52.253601 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0d9b7d7f-8034-4486-9513-5c6cc264b2ef admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:26:52.276785 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-0d9b7d7f-8034-4486-9513-5c6cc264b2ef admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.437078 Jul 21 17:26:52.277312 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jul 21 17:26:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:26:54.521229 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-8d1cd67e-7e44-4e0a-b053-6df576b8a925 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:26:54.522648 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-8d1cd67e-7e44-4e0a-b053-6df576b8a925 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Jul 21 17:26:54.523161 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:26:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:26:54.956346 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-1900da44-e428-42a2-9384-b4109a315c7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:54.976591 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-1900da44-e428-42a2-9384-b4109a315c7f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.445977 Jul 21 17:26:54.977151 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 17:26:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:26:54.991271 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-dbf40149-9f12-4d01-bc75-1629b4348030 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:55.023809 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-dbf40149-9f12-4d01-bc75-1629b4348030 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038005 Jul 21 17:26:55.028335 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jul 21 17:26:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:26:57.248855 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-1900da44-e428-42a2-9384-b4109a315c7f admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:26:57.249853 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-1900da44-e428-42a2-9384-b4109a315c7f admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 21 17:26:57.250255 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:26:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:26:57.639983 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-a5285cbc-e96e-4335-820e-8063410d932b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "name": "m1.small", "disk": 20, "swap": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:57.657115 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-a5285cbc-e96e-4335-820e-8063410d932b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.401035 Jul 21 17:26:57.657656 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 17:26:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:26:57.669543 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-dee0a0ca-a920-43f6-86b2-cefd3aa68ed6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:26:57.694648 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-dee0a0ca-a920-43f6-86b2-cefd3aa68ed6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028738 Jul 21 17:26:57.695220 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jul 21 17:26:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:26:59.904307 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-a5285cbc-e96e-4335-820e-8063410d932b admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:26:59.905464 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-a5285cbc-e96e-4335-820e-8063410d932b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Jul 21 17:26:59.906004 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:27:00.308568 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-b532d0a6-34e6-4ac9-8c1a-703695fdedbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:27:00.327147 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-b532d0a6-34e6-4ac9-8c1a-703695fdedbf admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.415120 Jul 21 17:27:00.328386 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 17:26:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:27:00.341007 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-093243a3-fa49-49f3-9c2c-f2ed4b844686 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:27:00.366360 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-093243a3-fa49-49f3-9c2c-f2ed4b844686 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029302 Jul 21 17:27:00.367094 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jul 21 17:27:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:27:02.675458 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-b532d0a6-34e6-4ac9-8c1a-703695fdedbf admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:02.675458 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-b532d0a6-34e6-4ac9-8c1a-703695fdedbf admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Jul 21 17:27:02.676141 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:27:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:27:03.122044 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-258aa474-6d27-494c-8672-f157e9255cd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "ram": 8192, "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:27:03.140191 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-258aa474-6d27-494c-8672-f157e9255cd6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458654 Jul 21 17:27:03.140854 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 17:27:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:27:03.153021 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-4f4f11e6-3d78-41f7-b37c-e71f3d4953d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:27:03.178443 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-4f4f11e6-3d78-41f7-b37c-e71f3d4953d8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029385 Jul 21 17:27:03.179242 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jul 21 17:27:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:27:05.435981 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-258aa474-6d27-494c-8672-f157e9255cd6 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:05.437134 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-258aa474-6d27-494c-8672-f157e9255cd6 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 21 17:27:05.438019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:27:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:27:05.941794 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0742c962-c96c-4ae5-93c4-c6d8f975d624 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 160}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:27:05.967861 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-0742c962-c96c-4ae5-93c4-c6d8f975d624 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.523342 Jul 21 17:27:05.968554 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jul 21 17:27:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:27:05.980918 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-5528c37b-3aef-4d5a-98d1-090ec3627ffd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:27:05.984510 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:27:06.010274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-5528c37b-3aef-4d5a-98d1-090ec3627ffd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033176 Jul 21 17:27:06.010792 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jul 21 17:27:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:27:25.789587 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0742c962-c96c-4ae5-93c4-c6d8f975d624 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:25.790589 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-0742c962-c96c-4ae5-93c4-c6d8f975d624 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 21 17:27:25.791009 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:27:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:27:25.801450 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:27:26.179882 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-21d3dca7-1a5d-43d7-acbd-001a0043c8da admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:26.197395 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-21d3dca7-1a5d-43d7-acbd-001a0043c8da admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400383 Jul 21 17:27:26.197872 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jul 21 17:27:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:27:27.288354 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0742c962-c96c-4ae5-93c4-c6d8f975d624 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:27.289376 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-0742c962-c96c-4ae5-93c4-c6d8f975d624 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 21 17:27:27.289759 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 17:27:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:27:27.800864 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-27a5d1d4-46f5-4371-b0af-321457bb3e7d admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:27.806728 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.wsgi [None req-27a5d1d4-46f5-4371-b0af-321457bb3e7d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-27a5d1d4-46f5-4371-b0af-321457bb3e7d admin admin] Request method failure captured: Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Accept: application/json Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Accept-Encoding: gzip, deflate Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Connection: keep-alive Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Content-Length: 0 Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Host: 10.222.0.57 Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Openstack-Api-Version: compute 2.90 Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Openstack-System-Scope: None Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: User-Agent: python-novaclient Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Auth-Token: gAAAAABi2Yx_aNQXNJlUaMJGqB84xiqNGUiQCEfXt1gLbzeQOb5Xxw6b-RsO2F5CCrosIMSD4Ajx7pE144FGX-qbX1ciusYOEKIVv9XI-rNvrlqUTM3inPkqRh1MTY0Fjeq5_cLo18K41gTTLaMxr-6KBgneTBvrk8SJg8BsCkTvCeMbzT5LiF8 Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Domain-Id: None Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Domain-Name: None Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Identity-Status: Confirmed Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Is-Admin-Project: True Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Project-Domain-Id: default Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Project-Domain-Name: Default Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Project-Id: ee47bf64e42844579243da3bda418cc7 Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Project-Name: admin Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Role: reader,member,admin Jul 21 17:27:27.810019 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Roles: reader,member,admin Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee47bf64e42844579243da3bda418cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee47bf64e42844579243da3bda418cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee47bf64e42844579243da3bda418cc7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee47bf64e42844579243da3bda418cc7"}]}] Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Tenant: admin Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Tenant-Id: ee47bf64e42844579243da3bda418cc7 Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Tenant-Name: admin Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User: admin Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User-Domain-Id: default Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User-Domain-Name: Default Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User-Id: 57de169446f4409f8d2242abb44a08b7 Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User-Name: admin Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: method: > Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: exception: Flavor 42 could not be found. Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: action_args: {'id': '42'} Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:27:27.811742 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:27:27.812844 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:27.814501 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-27a5d1d4-46f5-4371-b0af-321457bb3e7d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:27:27.815757 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-27a5d1d4-46f5-4371-b0af-321457bb3e7d admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.386438 Jul 21 17:27:27.815757 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jul 21 17:27:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 17:27:27.821891 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-9c5ba5b7-89e3-4d34-867b-4213d53cf4b3 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:27.824828 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:27:27.844411 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-9c5ba5b7-89e3-4d34-867b-4213d53cf4b3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026646 Jul 21 17:27:27.844951 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jul 21 17:27:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:27:27.854719 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-83af4a72-bee0-4fef-a3e1-4b4f2324f304 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:27.875727 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-83af4a72-bee0-4fef-a3e1-4b4f2324f304 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024521 Jul 21 17:27:27.876309 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jul 21 17:27:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:27:27.886247 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-63f9baa1-f1a3-4ff4-8231-e6595396f158 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:27.892416 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.wsgi [None req-63f9baa1-f1a3-4ff4-8231-e6595396f158 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-63f9baa1-f1a3-4ff4-8231-e6595396f158 admin admin] Request method failure captured: Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Accept: application/json Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Accept-Encoding: gzip, deflate Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Connection: keep-alive Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Content-Length: 0 Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Host: 10.222.0.57 Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Openstack-Api-Version: compute 2.90 Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Openstack-System-Scope: None Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: User-Agent: python-novaclient Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Auth-Token: gAAAAABi2Yx_aNQXNJlUaMJGqB84xiqNGUiQCEfXt1gLbzeQOb5Xxw6b-RsO2F5CCrosIMSD4Ajx7pE144FGX-qbX1ciusYOEKIVv9XI-rNvrlqUTM3inPkqRh1MTY0Fjeq5_cLo18K41gTTLaMxr-6KBgneTBvrk8SJg8BsCkTvCeMbzT5LiF8 Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Domain-Id: None Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Domain-Name: None Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Identity-Status: Confirmed Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Is-Admin-Project: True Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Project-Domain-Id: default Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Project-Domain-Name: Default Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Project-Id: ee47bf64e42844579243da3bda418cc7 Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Project-Name: admin Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Role: reader,member,admin Jul 21 17:27:27.896545 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Roles: reader,member,admin Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee47bf64e42844579243da3bda418cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee47bf64e42844579243da3bda418cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee47bf64e42844579243da3bda418cc7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee47bf64e42844579243da3bda418cc7"}]}] Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Tenant: admin Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Tenant-Id: ee47bf64e42844579243da3bda418cc7 Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Tenant-Name: admin Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User: admin Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User-Domain-Id: default Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User-Domain-Name: Default Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User-Id: 57de169446f4409f8d2242abb44a08b7 Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User-Name: admin Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: method: > Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: exception: Flavor 42 could not be found. Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: action_args: {'id': '42'} Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:27:27.898100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:27:27.899092 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:27.900180 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-63f9baa1-f1a3-4ff4-8231-e6595396f158 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:27:27.901218 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-63f9baa1-f1a3-4ff4-8231-e6595396f158 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015204 Jul 21 17:27:27.901218 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jul 21 17:27:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 17:27:28.869099 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-83af4a72-bee0-4fef-a3e1-4b4f2324f304 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:28.870148 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-83af4a72-bee0-4fef-a3e1-4b4f2324f304 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jul 21 17:27:28.870546 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 17:27:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:27:29.390094 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-afc4604b-4822-46ba-a1ec-2c389a4d659f admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:29.396417 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.wsgi [None req-afc4604b-4822-46ba-a1ec-2c389a4d659f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-afc4604b-4822-46ba-a1ec-2c389a4d659f admin admin] Request method failure captured: Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Accept: application/json Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Accept-Encoding: gzip, deflate Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Connection: keep-alive Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Content-Length: 0 Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Host: 10.222.0.57 Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Openstack-Api-Version: compute 2.90 Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Openstack-System-Scope: None Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: User-Agent: python-novaclient Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Auth-Token: gAAAAABi2YyAqVgWHcY8UxUD3Om4-Nz_hNJNPUwsvgnm1r3mCnpR5J50tQBu-joGJ1AS2e9zQhKJ4A9u--BVFv__0pUNT2jXHrmSuEENRcXkyZwJ5hn685rQbU57KyeBT5FcSrTk3mPpWCQurwsElICHdEnhhvqj2bpeiGsLlAFYNS57MwGS5uw Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Domain-Id: None Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Domain-Name: None Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Identity-Status: Confirmed Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Is-Admin-Project: True Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Project-Domain-Id: default Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Project-Domain-Name: Default Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Project-Id: ee47bf64e42844579243da3bda418cc7 Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Project-Name: admin Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Role: reader,member,admin Jul 21 17:27:29.397921 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Roles: reader,member,admin Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee47bf64e42844579243da3bda418cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee47bf64e42844579243da3bda418cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee47bf64e42844579243da3bda418cc7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee47bf64e42844579243da3bda418cc7"}]}] Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Tenant: admin Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Tenant-Id: ee47bf64e42844579243da3bda418cc7 Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Tenant-Name: admin Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User: admin Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User-Domain-Id: default Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User-Domain-Name: Default Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User-Id: 57de169446f4409f8d2242abb44a08b7 Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User-Name: admin Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: method: > Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: exception: Flavor 84 could not be found. Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: action_args: {'id': '84'} Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:27:29.399393 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:27:29.400347 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:29.401992 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-afc4604b-4822-46ba-a1ec-2c389a4d659f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:27:29.403203 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-afc4604b-4822-46ba-a1ec-2c389a4d659f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389249 Jul 21 17:27:29.403203 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jul 21 17:27:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 17:27:29.409152 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-ba42fa33-5e6b-49f0-9ace-8c3714b6a0cf admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:29.422727 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-ba42fa33-5e6b-49f0-9ace-8c3714b6a0cf admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017221 Jul 21 17:27:29.423319 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jul 21 17:27:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:27:29.432702 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-6a2108b6-0738-42e6-ac58-6c15a3e75558 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:29.447134 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-6a2108b6-0738-42e6-ac58-6c15a3e75558 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017834 Jul 21 17:27:29.447665 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jul 21 17:27:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:27:29.456689 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-bde55370-b835-431a-aa1d-f2b91b746fe7 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:29.462726 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.wsgi [None req-bde55370-b835-431a-aa1d-f2b91b746fe7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-bde55370-b835-431a-aa1d-f2b91b746fe7 admin admin] Request method failure captured: Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Accept: application/json Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Accept-Encoding: gzip, deflate Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Connection: keep-alive Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Content-Length: 0 Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Host: 10.222.0.57 Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Openstack-Api-Version: compute 2.90 Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Openstack-System-Scope: None Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: User-Agent: python-novaclient Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Auth-Token: gAAAAABi2YyAqVgWHcY8UxUD3Om4-Nz_hNJNPUwsvgnm1r3mCnpR5J50tQBu-joGJ1AS2e9zQhKJ4A9u--BVFv__0pUNT2jXHrmSuEENRcXkyZwJ5hn685rQbU57KyeBT5FcSrTk3mPpWCQurwsElICHdEnhhvqj2bpeiGsLlAFYNS57MwGS5uw Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Domain-Id: None Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Domain-Name: None Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Identity-Status: Confirmed Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Is-Admin-Project: True Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Project-Domain-Id: default Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Project-Domain-Name: Default Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Project-Id: ee47bf64e42844579243da3bda418cc7 Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Project-Name: admin Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Role: reader,member,admin Jul 21 17:27:29.464274 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Roles: reader,member,admin Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee47bf64e42844579243da3bda418cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee47bf64e42844579243da3bda418cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee47bf64e42844579243da3bda418cc7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee47bf64e42844579243da3bda418cc7"}]}] Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Tenant: admin Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Tenant-Id: ee47bf64e42844579243da3bda418cc7 Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Tenant-Name: admin Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User: admin Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User-Domain-Id: default Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User-Domain-Name: Default Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User-Id: 57de169446f4409f8d2242abb44a08b7 Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User-Name: admin Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: method: > Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: exception: Flavor 84 could not be found. Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: action_args: {'id': '84'} Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:27:29.465830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:27:29.466982 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:29.468343 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-bde55370-b835-431a-aa1d-f2b91b746fe7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:27:29.469578 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-bde55370-b835-431a-aa1d-f2b91b746fe7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012380 Jul 21 17:27:29.469578 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jul 21 17:27:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 17:27:30.436352 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-6a2108b6-0738-42e6-ac58-6c15a3e75558 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:30.437346 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-6a2108b6-0738-42e6-ac58-6c15a3e75558 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 21 17:27:30.437734 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 17:27:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:27:30.950707 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-0cc88b63-67ad-41a1-93aa-23d1cf202f62 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:30.956339 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.wsgi [None req-0cc88b63-67ad-41a1-93aa-23d1cf202f62 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-0cc88b63-67ad-41a1-93aa-23d1cf202f62 admin admin] Request method failure captured: Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Accept: application/json Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Accept-Encoding: gzip, deflate Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Connection: keep-alive Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Content-Length: 0 Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Host: 10.222.0.57 Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Openstack-Api-Version: compute 2.90 Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Openstack-System-Scope: None Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: User-Agent: python-novaclient Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Auth-Token: gAAAAABi2YyC7xicDfNWMCcSnQ55wo7iGMwhAgnOTyjm_Pe3CCJ-zYMtEd59ZvDgYoftdA7DisdDvzSGkula5EwovaULxlOsWDPHf0--Epa1Sj5ULBBzYFuAVm9yfCQ9Hxfz8BLjZYdYrIzYf0FBIOcogwCvQ8hJJpVoSJyiS4n38Ym3PYy3Q4Y Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Domain-Id: None Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Domain-Name: None Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Identity-Status: Confirmed Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Is-Admin-Project: True Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Project-Domain-Id: default Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Project-Domain-Name: Default Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Project-Id: ee47bf64e42844579243da3bda418cc7 Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Project-Name: admin Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Role: reader,member,admin Jul 21 17:27:30.957830 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Roles: reader,member,admin Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee47bf64e42844579243da3bda418cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee47bf64e42844579243da3bda418cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee47bf64e42844579243da3bda418cc7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee47bf64e42844579243da3bda418cc7"}]}] Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Tenant: admin Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Tenant-Id: ee47bf64e42844579243da3bda418cc7 Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-Tenant-Name: admin Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User: admin Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User-Domain-Id: default Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User-Domain-Name: Default Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User-Id: 57de169446f4409f8d2242abb44a08b7 Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: X-User-Name: admin Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: method: > Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: exception: Flavor 451 could not be found. Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: action_args: {'id': '451'} Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:27:30.959368 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:27:30.960475 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Jul 21 17:27:30.961958 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-0cc88b63-67ad-41a1-93aa-23d1cf202f62 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:27:30.963350 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-0cc88b63-67ad-41a1-93aa-23d1cf202f62 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386390 Jul 21 17:27:30.963350 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jul 21 17:27:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 17:27:30.968798 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-38fe903f-97e6-4b8c-ab9f-b8404576ca1b admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:30.982801 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-38fe903f-97e6-4b8c-ab9f-b8404576ca1b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017530 Jul 21 17:27:30.983329 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jul 21 17:27:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:27:30.993308 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:31.014250 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025188 Jul 21 17:27:31.014791 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jul 21 17:27:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 17:27:31.024694 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-87ba5918-1628-44a0-b91c-c604f9238bdc admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:31.032223 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.wsgi [None req-87ba5918-1628-44a0-b91c-c604f9238bdc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-87ba5918-1628-44a0-b91c-c604f9238bdc admin admin] Request method failure captured: Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Accept: application/json Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Accept-Encoding: gzip, deflate Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Connection: keep-alive Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Content-Length: 0 Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Host: 10.222.0.57 Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Openstack-Api-Version: compute 2.90 Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Openstack-System-Scope: None Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: User-Agent: python-novaclient Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Auth-Token: gAAAAABi2YyC7xicDfNWMCcSnQ55wo7iGMwhAgnOTyjm_Pe3CCJ-zYMtEd59ZvDgYoftdA7DisdDvzSGkula5EwovaULxlOsWDPHf0--Epa1Sj5ULBBzYFuAVm9yfCQ9Hxfz8BLjZYdYrIzYf0FBIOcogwCvQ8hJJpVoSJyiS4n38Ym3PYy3Q4Y Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Domain-Id: None Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Domain-Name: None Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Identity-Status: Confirmed Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Is-Admin-Project: True Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Project-Domain-Id: default Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Project-Domain-Name: Default Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Project-Id: ee47bf64e42844579243da3bda418cc7 Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Project-Name: admin Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Role: reader,member,admin Jul 21 17:27:31.035230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Roles: reader,member,admin Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee47bf64e42844579243da3bda418cc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee47bf64e42844579243da3bda418cc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee47bf64e42844579243da3bda418cc7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee47bf64e42844579243da3bda418cc7"}]}] Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Tenant: admin Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Tenant-Id: ee47bf64e42844579243da3bda418cc7 Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-Tenant-Name: admin Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User: admin Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User-Domain-Id: default Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User-Domain-Name: Default Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User-Id: 57de169446f4409f8d2242abb44a08b7 Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: X-User-Name: admin Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: method: > Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: exception: Flavor 451 could not be found. Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: action_args: {'id': '451'} Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:27:31.037431 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:27:31.038514 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 21 17:27:31.039806 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-87ba5918-1628-44a0-b91c-c604f9238bdc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:27:31.041724 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-87ba5918-1628-44a0-b91c-c604f9238bdc admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017531 Jul 21 17:27:31.041724 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jul 21 17:27:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 17:27:31.998334 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:31.999336 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 21 17:27:31.999732 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 17:27:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:27:32.516047 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-33b2007a-b1df-42a8-ba07-ec20ba62374e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:27:32.534882 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-33b2007a-b1df-42a8-ba07-ec20ba62374e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.395187 Jul 21 17:27:32.535448 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jul 21 17:27:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:27:33.492091 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:33.493126 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 21 17:27:33.493522 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 17:27:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:27:34.015676 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-2bd47bf9-ce19-4363-ade3-b6530e23310e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:27:34.033368 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-2bd47bf9-ce19-4363-ade3-b6530e23310e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.401925 Jul 21 17:27:34.033926 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jul 21 17:27:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:27:35.008511 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:35.009544 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 21 17:27:35.009945 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 17:27:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:27:35.535986 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-fd072247-f454-453e-8950-0c2cc512a041 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:27:35.554096 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-fd072247-f454-453e-8950-0c2cc512a041 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.402510 Jul 21 17:27:35.554644 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jul 21 17:27:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:27:36.520842 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:36.522834 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002476 Jul 21 17:27:36.523229 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 17:27:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:27:37.042985 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-165171d8-1caf-4210-99da-87d856120d6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:27:37.063072 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-165171d8-1caf-4210-99da-87d856120d6a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.397502 Jul 21 17:27:37.063613 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jul 21 17:27:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:27:38.030354 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:38.031359 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 21 17:27:38.031760 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 17:27:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:27:38.547951 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-88d02464-f3f4-42da-9c40-8d23e6d8b6ff admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:27:38.567817 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-88d02464-f3f4-42da-9c40-8d23e6d8b6ff admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.397459 Jul 21 17:27:38.568975 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Thu Jul 21 17:27:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:28:30.565227 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:28:30.566269 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-c4c359d4-d87c-497d-b54f-f93a55e6b856 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 21 17:28:30.566663 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jul 21 17:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:28:30.577823 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:28:30.958346 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-1b918828-c958-45a9-b849-26cc28ed129e admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:28:30.978770 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-1b918828-c958-45a9-b849-26cc28ed129e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405450 Jul 21 17:28:30.979302 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jul 21 17:28:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:28:31.000819 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_api:SELECT=14 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:28:31.004465 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-94dd7ca6-8af1-4da2-8c22-8b5f0a9d0586 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:28:31.012413 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-94dd7ca6-8af1-4da2-8c22-8b5f0a9d0586 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013057 Jul 21 17:28:31.012939 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1282 bytes} [Thu Jul 21 17:28:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:28:31.024842 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-867eed78-6982-4820-b467-bfca1250f92e admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:28:31.032429 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-867eed78-6982-4820-b467-bfca1250f92e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011706 Jul 21 17:28:31.032947 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1285 bytes} [Thu Jul 21 17:28:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:28:31.045187 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-f3b9b8ef-879a-48fd-a1ef-3eecc0243c2b admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:28:31.052621 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-f3b9b8ef-879a-48fd-a1ef-3eecc0243c2b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010957 Jul 21 17:28:31.053137 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1285 bytes} [Thu Jul 21 17:28:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:28:31.064523 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-a055e7b0-1f41-4c33-b6ce-60defd986671 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:28:31.072539 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-a055e7b0-1f41-4c33-b6ce-60defd986671 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011604 Jul 21 17:28:31.073058 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1282 bytes} [Thu Jul 21 17:28:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:31:55.167734 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-f3b9b8ef-879a-48fd-a1ef-3eecc0243c2b admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:31:55.168820 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-f3b9b8ef-879a-48fd-a1ef-3eecc0243c2b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001780 Jul 21 17:31:55.169217 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 17:31:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:31:55.310313 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=6 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:31:55.468230 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-957e0e69-24a3-49a5-a22e-a0fa7da575dc admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:31:55.469411 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 17:31:55.469411 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 21 17:31:55.470652 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-957e0e69-24a3-49a5-a22e-a0fa7da575dc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:31:55.471098 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-957e0e69-24a3-49a5-a22e-a0fa7da575dc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:31:55.471890 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-957e0e69-24a3-49a5-a22e-a0fa7da575dc admin admin] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:31:55.472341 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-957e0e69-24a3-49a5-a22e-a0fa7da575dc admin admin] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:31:55.506389 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-957e0e69-24a3-49a5-a22e-a0fa7da575dc admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.197620 Jul 21 17:31:55.506950 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jul 21 17:31:55 2022] GET /compute/v2.1/os-services => generated 794 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 17:31:56.331746 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-f3b9b8ef-879a-48fd-a1ef-3eecc0243c2b admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:31:56.332773 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-f3b9b8ef-879a-48fd-a1ef-3eecc0243c2b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 21 17:31:56.333303 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 17:31:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:31:56.527707 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-e424ddac-a6e6-41d2-86f5-5c09d75a39b3 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:31:56.528904 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 17:31:56.528904 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 21 17:31:56.530098 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-e424ddac-a6e6-41d2-86f5-5c09d75a39b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:31:56.530536 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-e424ddac-a6e6-41d2-86f5-5c09d75a39b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:31:56.531328 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-e424ddac-a6e6-41d2-86f5-5c09d75a39b3 admin admin] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:31:56.531755 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-e424ddac-a6e6-41d2-86f5-5c09d75a39b3 admin admin] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:31:56.550886 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-e424ddac-a6e6-41d2-86f5-5c09d75a39b3 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076478 Jul 21 17:31:56.551638 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jul 21 17:31:56 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:32:07.800500 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-f3b9b8ef-879a-48fd-a1ef-3eecc0243c2b admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:32:07.801533 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-f3b9b8ef-879a-48fd-a1ef-3eecc0243c2b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 21 17:32:07.801925 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 17:32:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:32:07.944757 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell0:SELECT=4 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:32:07.945482 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell1:SELECT=4 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:32:07.946100 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=8 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:32:07.995029 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-c920467b-145a-41f4-b539-77ffa6c7b8a3 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:32:07.996187 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 17:32:07.996187 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 21 17:32:07.997412 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-c920467b-145a-41f4-b539-77ffa6c7b8a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:32:07.997858 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-c920467b-145a-41f4-b539-77ffa6c7b8a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:32:07.998670 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-c920467b-145a-41f4-b539-77ffa6c7b8a3 admin admin] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:32:07.999103 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-c920467b-145a-41f4-b539-77ffa6c7b8a3 admin admin] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:32:08.024386 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-c920467b-145a-41f4-b539-77ffa6c7b8a3 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083946 Jul 21 17:32:08.024906 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jul 21 17:32:07 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:32:08.854636 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-f3b9b8ef-879a-48fd-a1ef-3eecc0243c2b admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:32:08.855647 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-f3b9b8ef-879a-48fd-a1ef-3eecc0243c2b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 21 17:32:08.856045 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jul 21 17:32:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:32:09.047039 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-1b532207-9b38-41d5-9424-4ffcb049fd1a admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:32:09.048196 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 17:32:09.048196 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 21 17:32:09.049412 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-1b532207-9b38-41d5-9424-4ffcb049fd1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:32:09.049851 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-1b532207-9b38-41d5-9424-4ffcb049fd1a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:32:09.050623 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-1b532207-9b38-41d5-9424-4ffcb049fd1a admin admin] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:32:09.051084 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-1b532207-9b38-41d5-9424-4ffcb049fd1a admin admin] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:32:09.073186 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-1b532207-9b38-41d5-9424-4ffcb049fd1a admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.077424 Jul 21 17:32:09.073907 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jul 21 17:32:08 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:33:04.997310 dv-cinder-825492-27-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 21 17:33:04.998014 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: Thu Jul 21 17:33:04 2022 - graceful shutdown triggered... Jul 21 17:33:04.998556 dv-cinder-825492-27-iscsi devstack@n-api.service[103408]: Gracefully killing worker 1 (pid: 103408)... Jul 21 17:33:04.998992 dv-cinder-825492-27-iscsi devstack@n-api.service[103409]: Gracefully killing worker 2 (pid: 103409)... Jul 21 17:33:05.998869 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: worker 1 buried after 1 seconds Jul 21 17:33:05.998869 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: worker 2 buried after 1 seconds Jul 21 17:33:05.998869 dv-cinder-825492-27-iscsi devstack@n-api.service[103407]: goodbye to uWSGI. Jul 21 17:33:06.000426 dv-cinder-825492-27-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 21 17:33:06.001197 dv-cinder-825492-27-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 21 17:33:06.004070 dv-cinder-825492-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 17:33:06.015000 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 17:33:06 2022] *** Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: nodename: dv-cinder-825492-27-iscsi Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: machine: x86_64 Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: clock source: unix Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: pcre jit disabled Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: detected number of CPU cores: 4 Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: current working directory: / Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: detected binary path: /usr/bin/uwsgi-core Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: your processes number limit is 47680 Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: your memory page size is 4096 bytes Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: detected max file descriptor number: 2048 Jul 21 17:33:06.017661 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: lock engine: pthread robust mutexes Jul 21 17:33:06.018748 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: thunder lock: enabled Jul 21 17:33:06.018748 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 17:33:06.018748 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 17:33:06.063955 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: Python main interpreter initialized at 0x561a57b4f9c0 Jul 21 17:33:06.063955 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: python threads support enabled Jul 21 17:33:06.063955 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: your server socket listen backlog is limited to 100 connections Jul 21 17:33:06.063955 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: your mercy for graceful operations on workers is 90 seconds Jul 21 17:33:06.064412 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 17:33:06.064515 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: *** Operational MODE: preforking *** Jul 21 17:33:06.064740 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: *** uWSGI is running in multiple interpreter mode *** Jul 21 17:33:06.064740 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: spawned uWSGI master process (pid: 124359) Jul 21 17:33:06.064956 dv-cinder-825492-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 17:33:06.065528 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: spawned uWSGI worker 1 (pid: 124380, cores: 1) Jul 21 17:33:06.065876 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: spawned uWSGI worker 2 (pid: 124381, cores: 1) Jul 21 17:33:06.067028 dv-cinder-825492-27-iscsi devstack@n-api.service[124359]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 17:33:06.736576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 17:33:06.739845 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 17:33:07.933058 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 17:33:07.933058 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: from cryptography.utils import int_from_bytes Jul 21 17:33:07.933664 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 17:33:07.933664 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: from cryptography.utils import int_from_bytes Jul 21 17:33:07.969327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 17:33:07.969327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: from cryptography.utils import int_from_bytes Jul 21 17:33:07.969939 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 17:33:07.969939 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: from cryptography.utils import int_from_bytes Jul 21 17:33:10.267463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 17:33:10.268012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 17:33:10.268274 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 17:33:10.268656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 17:33:10.268920 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 17:33:10.269328 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.269646 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.269974 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.270295 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.270632 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.270945 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.271270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.271592 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.271925 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.272191 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.272535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.272866 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-27-iscsi {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.273191 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.273501 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.273814 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.274135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.274442 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.274769 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.275076 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.275585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.276038 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.276375 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.276693 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.277036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.277362 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.277680 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.277991 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.278306 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.278637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.278951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.279378 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-27-iscsi {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.279727 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.280025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.280381 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.280787 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.281104 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.281420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.281748 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.282080 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.282395 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.282733 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.283084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.283386 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.283712 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.284018 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.284351 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.284671 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.284993 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.285312 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.285617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.285875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.286184 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.286515 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.286842 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.287169 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.287424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.287679 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.288007 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.288352 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.288669 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.288981 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.289293 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.289604 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.289915 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.290229 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.290538 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.290849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.291178 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.291499 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.291828 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.292142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.292562 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.292969 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.293226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.293541 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.293889 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.294214 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.294528 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.295453 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.295818 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.296137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.296482 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.296801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.297131 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.297474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.297784 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.298042 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.298351 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.298661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.298987 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.299298 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.299611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.299923 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.300234 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.300576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.300890 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.301202 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.301516 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.301828 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.302138 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.302450 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.302762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.303072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.303398 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.303725 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.304037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.304369 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.304684 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.304998 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.305330 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.305643 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.305953 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.306280 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.306589 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.306900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.307226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.307563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.307855 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.308178 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.308508 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.308820 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.309145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.309458 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.309771 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.310081 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.310411 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.311261 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.311573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.311882 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.312193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.312966 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.312966 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.313139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.313452 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.313765 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.314075 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.314403 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.314743 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.315083 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.315440 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.315761 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.317147 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.317147 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.317147 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.317147 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.317463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.317716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.318033 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.318351 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.318668 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.318990 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.319313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.319647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.319968 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.320400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.320744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.321060 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.321382 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.321908 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.322250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.322565 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.322914 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.323268 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.323591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.324180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.324605 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.324927 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.325249 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.325568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.325899 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.326329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.326650 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.326977 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.327295 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.327615 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.327933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.328250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.328592 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.328938 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.329260 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.329582 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.329901 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.330226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.330542 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.330862 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.331068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 17:33:10.331483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.331589 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 17:33:10.331696 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.331788 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.331949 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 17:33:10.332059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.332285 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 17:33:10.332411 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.332574 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 17:33:10.332695 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.332973 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.333071 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.333309 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.333401 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.333642 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.333738 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.333977 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.334075 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.334289 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.334386 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.334607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.334697 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.334924 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.335024 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.335244 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.335334 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.335557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.335647 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.335836 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.335938 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.336163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.336259 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.336508 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.336627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-27-iscsi {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.336840 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.336960 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.337155 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.337256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.337462 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.337552 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.337787 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.337884 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.338095 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.338185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.338406 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.338497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.338724 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.338819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.339038 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.339239 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.339353 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.339559 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.339658 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.339871 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.339961 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.340188 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.340278 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.340560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.340660 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.340889 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.341017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.341207 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.341306 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.341535 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.341671 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.341878 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.342007 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.342202 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.342321 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.342517 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.342802 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.342908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-27-iscsi {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.343135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.343232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.343453 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.343559 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.343771 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.343869 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.344085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.344249 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.344424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.344596 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.344737 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.344914 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.345053 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.345245 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.345372 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.345579 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.345670 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.345897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.345987 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.346232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.346330 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.346572 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.346679 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.346887 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.346978 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.347240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.347347 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.347500 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.347614 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.347819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.348135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.348466 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.348593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.348789 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.348886 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.349102 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.349209 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.349353 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.349446 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.349670 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.349824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.349995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.350153 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.350346 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.350533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.350692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.350786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.351061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.351162 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.351315 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.351430 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.351600 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.351761 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.351927 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.352036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.352281 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.352474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.352616 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.352757 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.352915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.353073 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.353226 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.353368 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.353516 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.353676 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.353839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.353991 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.354180 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.354341 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.354487 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.354637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.354824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.355062 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.355219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.355369 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.355571 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.355726 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.355882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.356038 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.356206 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.356447 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.356605 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.356779 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.356779 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.357102 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.357253 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.357996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.358579 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.358737 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.358893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.359043 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.359196 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.359346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.359496 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.359698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.359895 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.360060 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.360212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.360404 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.360554 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.360707 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.360857 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.360997 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.361168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.361325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.361475 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.361628 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.361770 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.361910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.362057 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.362199 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.362370 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.362565 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.362762 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.362918 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.363066 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.363224 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.363366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.363517 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.363699 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.363848 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.364035 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.364205 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.364495 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.364663 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.364813 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.365004 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.365167 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.365347 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.365515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.365704 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.365866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.366016 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.366202 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.366360 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.367075 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.367220 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.367369 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.367518 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.367669 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.367811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.367968 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.368127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.368269 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.368269 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.368588 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.368745 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.368887 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.369027 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.369174 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.369174 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.369455 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.369609 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.369751 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.369897 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.370062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.370211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.370359 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.370662 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.370823 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.370965 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.371114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.371255 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.371415 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.371588 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.372351 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.372508 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.372665 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.372828 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.373623 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.373878 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.374030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.374172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.374327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.374476 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.374618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.374767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.374908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.375064 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.375215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.375374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.375517 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.375664 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.375806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.375960 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.376102 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.376249 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.376426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.376596 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.376808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.376970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.377121 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.377272 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.377424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.377565 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.377705 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.377855 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.377996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.378137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.378284 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.378425 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.378573 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.378732 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.378880 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.379021 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.379162 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.379314 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.379464 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.379605 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.379752 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 17:33:10.379900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.380047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.380194 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.380386 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.380541 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.380684 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.380830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.380978 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.381120 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.381284 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.381427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.381567 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.381724 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.381872 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.382026 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.382168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.382309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.382457 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.382598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.382745 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.382895 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.383053 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.383201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.383349 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.383492 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.383646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.383983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.384139 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.384281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.384460 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.384601 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.384753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.384909 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.385057 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.385215 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.385438 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.385584 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.385725 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.385865 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.386004 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.386150 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.386304 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.386445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.386594 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.386742 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.386974 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.387121 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.387286 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.387436 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.387579 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.387719 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.387905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.388088 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.388236 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.388449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.388621 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.388871 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.389130 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.389299 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.389455 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.389598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.389740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.389880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.390028 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.390182 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.390324 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.390472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.390620 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.390762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.390910 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.391059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.391211 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.391364 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.391512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.391671 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.391824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.391975 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.392125 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.392266 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.392429 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.392580 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.392731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.392882 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.393031 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.393172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.393330 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.393479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.393629 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.393771 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.393920 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.394061 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.394061 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.394335 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.394484 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.394632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.394779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.394940 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.395102 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.395322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.395477 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.395625 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.395773 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.395921 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.396070 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.396221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.396412 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.396567 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.396708 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.396855 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.397083 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.397252 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.397400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.397550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.397691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.397838 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.397979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.398133 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.398274 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.398414 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.398644 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.398791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.398946 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.399096 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.399256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.399398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.399546 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.399695 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.399846 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.399987 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.400135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.400284 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.400459 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.400459 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.400737 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.400885 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.401041 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.401200 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.401355 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.401511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.401677 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.401832 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.401988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.402135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.402282 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.402442 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.402597 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.402745 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.402892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.403045 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.403218 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.403377 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.403377 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.403657 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.403804 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.403949 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.404095 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.404380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.404612 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.404766 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.404914 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.405073 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.405234 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.405398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.405553 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.405702 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.405857 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.406005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.406165 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.406321 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.406471 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.406618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.406764 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.406764 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.407085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.407317 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.407479 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.407635 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.407791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.407945 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.408107 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.408256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.408439 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.408597 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.408744 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.408898 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.409058 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.409212 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.409377 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.409525 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.409673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.409845 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.410043 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.410194 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.410348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.410504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.410660 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.410822 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.410972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.411126 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.411276 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.411437 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.411592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.411756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.411905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.412059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.412207 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.412385 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.412551 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.412700 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.412848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.412994 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.413141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.413305 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.413463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.413618 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.413775 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.413929 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.414085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.414233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.414389 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.414537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.414713 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.414862 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.415009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.415163 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.415331 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.415480 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.415635 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.415791 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.415941 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.416088 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.416243 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.416463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.416631 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.416779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.416979 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.417215 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.417451 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.417617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.417774 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.417938 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.418097 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.418256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.418406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.418561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.418561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.418872 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.419027 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.419190 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.419346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.419494 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.419651 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.420386 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.420587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.420748 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.420896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.421044 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.421198 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.421347 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.421502 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.421661 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.421808 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.421962 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.422109 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.422268 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.422425 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.422581 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.422735 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.422892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.423047 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.423195 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.423352 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.423500 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.423647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.423793 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.423939 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.424103 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.424261 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.424529 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.424678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.424825 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.424972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.425203 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.425363 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.425513 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.425668 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.425823 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.425978 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.426136 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.426295 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.426451 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.426605 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.426755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.426902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.427061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.427217 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.427375 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.427621 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.427784 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.427933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.428094 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.428251 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.428431 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.428591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.428743 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.428902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.429052 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.429198 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.429345 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.429546 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.429707 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.429865 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.430014 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.430161 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.430309 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.430466 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.430623 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.430784 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.430940 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.431108 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.431388 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.431561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.431721 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.431878 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.432107 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.432282 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.432501 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.432668 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.432827 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.432985 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.433141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.433296 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.433452 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.433600 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.433761 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.433909 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.434067 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.434215 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.434369 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.434517 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.434690 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.434841 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.434989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.435143 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.435298 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.435492 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.436171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.436352 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.436516 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.436747 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.436906 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.437054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.437212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.437378 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.437535 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.437771 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.437936 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.438094 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.438250 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.438398 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.438552 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.438707 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.438867 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.439025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.439175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.439329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.439495 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.439644 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.439791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.439948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.440097 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.440244 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.440440 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.440589 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.440756 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.440905 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.441061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.441219 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.441389 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.441537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.441698 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.441847 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.441994 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.442217 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.442386 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.442535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.442711 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.442860 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.443008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.443156 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.443311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.443478 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.443637 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.443793 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.443941 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.444097 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.444246 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.444434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.444434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.444724 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.444873 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.445020 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.445166 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.445328 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.445493 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.445643 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.445798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.445946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.446102 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.446258 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.446415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.446575 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.446730 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.446886 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.447040 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.447199 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.447356 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.447528 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.447690 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.447690 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.448080 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.448229 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.448404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.448562 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.448987 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.449154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.449311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.449311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.449602 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.449762 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.449919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.450074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.450222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.450370 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.450517 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.450671 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.450837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.450994 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.451262 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.451498 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.451664 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.451825 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.451992 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.452149 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.452336 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.452524 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.452674 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.452839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.452988 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.453136 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.453281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.453429 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.453576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.453733 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.453880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.454045 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.454200 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.454349 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.454495 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.454718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.454870 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.455029 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.455185 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.455341 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.455502 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.455502 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.455799 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.455958 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.456114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.456262 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.456463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.456621 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.456778 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.456926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.457081 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.457228 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.457384 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.457532 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.457679 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.457833 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.458088 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.458253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.458409 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.458558 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.458706 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.458854 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.459002 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.459162 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.459311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.459459 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.459606 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.459759 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.459909 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.460080 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.460241 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.460445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.460604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.460759 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.460915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.461074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.461232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.461379 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.461527 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.461674 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.461835 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.461983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.462141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.462295 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.462451 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.462598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.462758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.462961 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.463124 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.463281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.463429 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.463583 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.463740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.463896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.464051 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.464216 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.464398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.464398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.464703 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.464853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.464999 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.465148 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.465295 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.465454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.465603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.465758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.465912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.466070 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.466226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.466388 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.466544 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.466712 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.466865 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.467033 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.467183 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.467345 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.467533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.467737 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.467900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.468083 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.468339 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.468509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.468659 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.468806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.468960 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.469118 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.469267 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.469422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.469572 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.469720 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.469867 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.470023 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.470182 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.470337 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.470494 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.470643 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.470799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.470958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.470958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.471259 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.471259 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.471540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.471540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.471832 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.471997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.472153 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.472362 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.472518 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.472678 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.472835 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.472991 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.473148 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.473302 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.473459 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.473616 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.473770 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.473920 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.474078 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.474234 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.474399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.474548 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.474698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.474852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.475007 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.475162 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.475319 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.475319 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.475615 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.475771 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.475930 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.476156 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.476334 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.476499 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.476686 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.476858 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.477074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.477074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.477373 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.477522 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.477669 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.477824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.477974 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.478146 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.478320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.478556 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.478710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.478858 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.479006 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.479166 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.479315 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.479463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.479617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.479766 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.479927 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.480082 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.480240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.480431 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.480581 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.480728 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.480901 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.481054 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.481201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.481356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.481511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.481659 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.481816 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.481973 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.482121 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.482814 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.482973 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.483130 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.483287 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.483437 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.483584 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.483732 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.483732 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.484024 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.484174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.484348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.484515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.484686 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.484837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.484992 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.485142 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.485290 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.485444 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.485592 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.485746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.485904 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.486060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.486209 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.486364 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.486513 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.486674 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.486831 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.486980 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.487127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.487283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.487438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.487600 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.487749 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.487897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.488044 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.488191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.488392 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.488577 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.488821 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.488982 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.489139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.489296 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.489445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.489602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.489751 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.489898 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.490045 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.490192 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.490340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.490497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.490662 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.490812 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.490996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.490996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.491314 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.491475 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.491631 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.491786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.491948 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.492104 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.492266 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.492449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.492607 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.492774 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.492923 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.493078 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.493240 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.493396 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.493545 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.493694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.493841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.493996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.494154 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.494302 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.494450 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.494599 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.494763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.494926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.495082 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.495230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.495380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.495527 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.495675 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.495836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.495992 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.496141 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.496312 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.496478 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.496629 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.496796 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.496953 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.497102 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.497249 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.497397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.497552 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.497715 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.497865 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.498622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.498794 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.499030 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.499193 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.499355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.499504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.499658 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.499809 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.499809 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.500111 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.500111 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.500450 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.500600 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.500747 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.500902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.501064 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.501228 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.501392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.501539 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.501687 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.501841 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.502004 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.502160 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.502316 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.502472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.502627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.502784 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.502934 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.503082 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.503229 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.503393 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.503554 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.503712 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.503860 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.504008 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.504156 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.504322 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.504487 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.504648 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.504799 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.504946 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.505095 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.505259 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.505422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.505578 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.505727 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.505873 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.506030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.506178 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.506401 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.506552 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.506701 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.506860 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.507016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.507166 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.507337 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.507486 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.507641 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.507797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.507945 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.508100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.508259 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.508434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.508593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.508742 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.508889 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.509062 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.509306 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.509468 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.509625 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.509773 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.509921 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.510082 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.510241 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.510390 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.510545 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.510701 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.510850 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.511006 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.511177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.511339 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.511496 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.511645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.511803 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.511959 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.512110 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.512258 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.512470 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.512621 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.512777 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.512927 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.513074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.513235 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.513384 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.513570 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.513765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.513924 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.514074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.514223 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.514379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.514529 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.514687 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.514836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.514993 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.515142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.515308 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.515470 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.515628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.515783 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.515931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.516086 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.516242 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.516444 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.516604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.516754 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.516902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.517058 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.517207 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.517378 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.517538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.517695 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.517845 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.517992 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.518147 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.518304 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.518453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.518600 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.518766 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.519589 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.519766 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.519918 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.520079 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.520230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.520472 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.520631 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.520793 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.520944 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.521103 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.521257 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.521419 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.521569 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.521731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.521889 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.522056 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.522214 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.522377 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.522528 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.522689 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.522847 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.522997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.523144 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.523144 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.523434 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.523591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.523741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.523897 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.524065 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.524223 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.524408 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.524559 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.524718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.524875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.525051 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.525540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.525711 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.525868 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.526019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.526167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.526315 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.526481 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.526650 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.526808 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.526964 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.527114 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.527269 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.527432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.527582 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.527730 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.527892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.528042 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.528197 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.528429 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.528586 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.528734 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.528734 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.529024 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.529813 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.529983 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.530142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.530360 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.530516 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.530673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.530838 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.530988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.531155 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.531314 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.531477 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.531630 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.531790 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.531940 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.532112 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.532399 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.532590 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.532742 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.532903 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.533061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.533222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.533381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.533537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.533696 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.533845 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.534004 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.534162 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.534319 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.534469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.534631 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.534781 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.534936 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.535102 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.535266 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.535417 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.535575 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.535730 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.535879 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.536031 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.536180 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.536371 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.536528 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.536677 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.536833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.537005 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.537163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.537394 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.537548 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.537786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.537971 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.538122 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.538272 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.538430 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.538582 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.538731 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.538880 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.539036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.539216 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.539378 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.539530 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.539680 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.539849 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.540119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 17:33:10.540289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.540289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.540289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.540289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.540289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.540289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.540289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.540289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.541459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.541459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.541459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.541459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.541459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.541459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.541459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.541459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.543490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.543490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.543490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.543490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.543490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.543490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.543490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.543490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.544708 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.544708 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.544708 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.545755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.545755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.546146 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.546304 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.546587 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.546927 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.547246 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.547562 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.547971 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.548288 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.548554 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.548871 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.549196 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.549515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.549831 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.550189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.550466 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.550807 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.551125 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.551443 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.551758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.552080 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.553121 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.553121 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.553121 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.553597 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.553753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.553963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.554285 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.554600 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.554920 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.555236 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.555555 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.555934 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.556277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.556618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.556933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.557265 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.557586 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.557920 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.558244 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.558563 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.558931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.559261 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.559866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.560208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.560603 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.560956 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.561301 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.561725 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.562045 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.562363 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.562700 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.562700 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.562700 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.563804 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.563960 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.564248 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.564597 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.564917 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.565236 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.565554 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.566406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.566406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.566723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.566892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.567120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.567485 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.567816 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.568146 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.568614 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.568817 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.569138 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.569460 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.569779 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.570099 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.570468 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.570767 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.571095 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.571412 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.571859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.572183 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.573538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.573538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.573538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.574058 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.574383 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.574704 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.575037 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.575359 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.575707 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.576131 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.576748 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.577121 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.577441 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.578150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.578150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.578600 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.578874 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.579037 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.579295 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.579608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.579929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.580244 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.580609 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.580898 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.581212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.581529 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.581842 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.582157 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.582470 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.582944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.583461 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.583461 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.583926 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.584099 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.584445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.584714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.585031 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.585344 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.585699 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.586047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.586372 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.586706 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.587029 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.587362 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.587681 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.588014 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.588371 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.588704 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.589024 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.589368 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.589689 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.590012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.590336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.590762 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.590975 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.591297 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.592627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.592900 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.593189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.593690 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.593690 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.594155 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.594311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.594626 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.594971 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.595294 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.595616 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.595945 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.596270 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.596626 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.596956 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.597279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.597603 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.597932 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.598843 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.598843 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.599285 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.599285 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.599576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.599892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.600262 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.600646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.601012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.601353 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.601681 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.602006 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.602322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 17:33:10.602576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 17:33:10.691874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO dbcounter [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] Registered counter for database nova_api Jul 21 17:33:10.712478 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_db.sqlalchemy.engines [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:33:10.719742 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writer thread running {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:33:10.757078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO dbcounter [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] Registered counter for database nova_api Jul 21 17:33:10.775738 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.context [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d906d140-42ad-4012-a7e5-1433e18e34ea(cell1) {{(pid=124380) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 17:33:10.777119 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:33:10.780680 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:33:10.782299 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:33:10.783126 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:33:10.784229 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writer thread running {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:33:10.785175 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:33:10.787207 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO dbcounter [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] Registered counter for database nova_cell0 Jul 21 17:33:10.791293 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO dbcounter [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] Registered counter for database nova_cell1 Jul 21 17:33:10.799563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_db.sqlalchemy.engines [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:33:10.801786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_db.sqlalchemy.engines [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:33:10.808289 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writer thread running {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:33:10.811159 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writer thread running {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:33:10.842912 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.context [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d906d140-42ad-4012-a7e5-1433e18e34ea(cell1) {{(pid=124381) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 17:33:10.847040 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:33:10.848669 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:33:10.849504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:33:10.851500 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:33:10.853526 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO dbcounter [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] Registered counter for database nova_cell0 Jul 21 17:33:10.858190 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO dbcounter [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] Registered counter for database nova_cell1 Jul 21 17:33:10.865732 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:33:10.867060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:33:10.874333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writer thread running {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:33:10.875619 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writer thread running {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:33:10.957863 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO dbcounter [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] Registered counter for database nova_cell0 Jul 21 17:33:10.964563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_db.sqlalchemy.engines [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:33:10.969758 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writer thread running {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:33:11.020390 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO dbcounter [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] Registered counter for database nova_cell0 Jul 21 17:33:11.026810 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 17:33:11.032175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writer thread running {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 17:33:11.294333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: WARNING keystonemiddleware.auth_token [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 17:33:11.302096 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: WARNING keystonemiddleware.auth_token [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 17:33:11.352227 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: WARNING keystonemiddleware.auth_token [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 17:33:11.359695 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: WARNING keystonemiddleware.auth_token [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 17:33:11.649767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: WARNING keystonemiddleware.auth_token [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 17:33:11.656175 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: WARNING keystonemiddleware.auth_token [None req-a7cf26bc-bace-48e3-aadf-ba1500b36d65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 17:33:11.662380 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561a57b4f9c0 pid: 124380 (default app) Jul 21 17:33:11.706415 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: WARNING keystonemiddleware.auth_token [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 17:33:11.712431 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: WARNING keystonemiddleware.auth_token [None req-d1e631da-4bf6-48eb-ac37-43cc5681845d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 17:33:11.718656 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561a57b4f9c0 pid: 124381 (default app) Jul 21 17:33:53.249077 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:33:53.250274 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:33:53.251082 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:33:53.252122 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:33:54.620514 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-edf4c5fe-f102-4e7c-a8aa-605c3d42d652 tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] Action: 'create', calling method: .version_select at 0x7ffa2c4a0ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1537210257", "metadata": {"Type": "work"}}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:33:55.920354 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-edf4c5fe-f102-4e7c-a8aa-605c3d42d652 tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.680854 Jul 21 17:33:55.920354 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Jul 21 17:33:53 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2684 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 17:33:55.942840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=3 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:33:55.944221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=3 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:33:55.949266 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=3 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:33:55.949266 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=3 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:33:56.106228 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-529fbc86-ce2a-482d-8d2c-ca240e271f35 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] Calling method '.version_select at 0x7ffa2c2fdaf0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:33:56.295569 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-529fbc86-ce2a-482d-8d2c-ca240e271f35 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/0abed9d5-5a9c-4f7e-8134-9711ce8be54e" status: 200 len: 351 microversion: 2.1 time: 0.194716 Jul 21 17:33:56.302712 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 2/2] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 17:33:56 2022] GET /compute/v2.1/os-volumes/0abed9d5-5a9c-4f7e-8134-9711ce8be54e => generated 351 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:33:56.526282 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5b8ad698-314a-4e93-86a3-8a16936cb107 tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] Calling method '.version_select at 0x7ffa2c47e940>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:33:57.156593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5b8ad698-314a-4e93-86a3-8a16936cb107 tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/d969dd52-7c68-4c69-b186-d27c3a734910" status: 200 len: 354 microversion: 2.1 time: 1.227183 Jul 21 17:33:57.168251 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 1/3] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 17:33:55 2022] GET /compute/v2.1/os-volumes/d969dd52-7c68-4c69-b186-d27c3a734910 => generated 354 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:33:57.171076 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-33e4d8b9-eb5d-42c6-8192-606e581a1e67 tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] Calling method '.version_select at 0x7ffa2c2fdca0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:33:57.280827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-33e4d8b9-eb5d-42c6-8192-606e581a1e67 tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/d969dd52-7c68-4c69-b186-d27c3a734910" status: 200 len: 354 microversion: 2.1 time: 0.115950 Jul 21 17:33:57.281407 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 17:33:57 2022] GET /compute/v2.1/os-volumes/d969dd52-7c68-4c69-b186-d27c3a734910 => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:33:57.304908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-287ae796-53bf-44af-b84b-0e3a3dfe812f tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] Calling method '.version_select at 0x7ffa2c341af0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:33:57.489806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-287ae796-53bf-44af-b84b-0e3a3dfe812f tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/d969dd52-7c68-4c69-b186-d27c3a734910" status: 202 len: 0 microversion: 2.1 time: 0.192665 Jul 21 17:33:57.493795 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 2/5] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 17:33:57 2022] DELETE /compute/v2.1/os-volumes/d969dd52-7c68-4c69-b186-d27c3a734910 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 17:33:57.501023 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b6214e3f-76ca-4ef0-a57c-d7b716c9b8e7 tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] Calling method '.version_select at 0x7ffa2c318310>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:33:57.666241 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b6214e3f-76ca-4ef0-a57c-d7b716c9b8e7 tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/d969dd52-7c68-4c69-b186-d27c3a734910" status: 200 len: 353 microversion: 2.1 time: 0.168643 Jul 21 17:33:57.667956 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 4/6] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 17:33:57 2022] GET /compute/v2.1/os-volumes/d969dd52-7c68-4c69-b186-d27c3a734910 => generated 353 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:33:58.170180 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ff7490c2-5c01-4d7b-b62f-54756e3d368e tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] Calling method '.version_select at 0x7ffa2c3061f0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:33:58.491491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ff7490c2-5c01-4d7b-b62f-54756e3d368e tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b3dbb505-bb86-45ed-a307-2e04ba85ad93" status: 200 len: 351 microversion: 2.1 time: 0.338968 Jul 21 17:33:58.498718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 17:33:58 2022] GET /compute/v2.1/os-volumes/b3dbb505-bb86-45ed-a307-2e04ba85ad93 => generated 351 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:33:58.685063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c01fcb90-7082-4f03-b423-aecd3920ea7e tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] Calling method '.version_select at 0x7ffa2c3189d0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:33:58.738569 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-c01fcb90-7082-4f03-b423-aecd3920ea7e tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] HTTP exception thrown: Volume d969dd52-7c68-4c69-b186-d27c3a734910 could not be found. Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c01fcb90-7082-4f03-b423-aecd3920ea7e tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] Request method failure captured: Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/os-volumes/d969dd52-7c68-4c69-b186-d27c3a734910 HTTP/1.1 Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y4BV7qns3v91jlNTRrrSdA5HdSnXGskd5dVFZ1bAZWl6evQEKDarkmedjZAUVrapj572WpvEP77ErIWy6WEGHS729oKdhkjFvY55zriLzN1xWLBWA0XE5NTNuVsHpJH7KpNRuBqrOU8fO2_4vz7-MzlP4xFYdK4Ije97yN5sB-3PT8 Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 1fd3b826ab3d4dfe977c098f0071762d Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesGetTestJSON-1104291714 Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 17:33:58.743054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1fd3b826ab3d4dfe977c098f0071762d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1fd3b826ab3d4dfe977c098f0071762d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1fd3b826ab3d4dfe977c098f0071762d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1fd3b826ab3d4dfe977c098f0071762d"}]}] Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesGetTestJSON-1104291714 Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 1fd3b826ab3d4dfe977c098f0071762d Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesGetTestJSON-1104291714 Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesGetTestJSON-1104291714-project Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: e940d6ceaa6d48be8dbfe4c6ce6f6238 Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesGetTestJSON-1104291714-project Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Volume d969dd52-7c68-4c69-b186-d27c3a734910 could not be found. Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': 'd969dd52-7c68-4c69-b186-d27c3a734910'} Jul 21 17:33:58.744101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d969dd52-7c68-4c69-b186-d27c3a734910 could not be found. (HTTP 404) (Request-ID: req-cbe87775-348f-44fe-998f-fee572f1ea4b) Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:33:58.744767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 17:33:58.745675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d969dd52-7c68-4c69-b186-d27c3a734910 could not be found. Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 17:33:58.749365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:33:58.750222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d969dd52-7c68-4c69-b186-d27c3a734910 could not be found. Jul 21 17:33:58.750222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:33:58.750222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:33:58.750222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:33:58.750222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:33:58.750222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:33:58.750222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:33:58.750222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:33:58.750222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:33:58.750222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d969dd52-7c68-4c69-b186-d27c3a734910 could not be found. Jul 21 17:33:58.750222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:33:58.753198 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c01fcb90-7082-4f03-b423-aecd3920ea7e tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] Returning 404 to user: Volume d969dd52-7c68-4c69-b186-d27c3a734910 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:33:58.754271 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c01fcb90-7082-4f03-b423-aecd3920ea7e tempest-VolumesGetTestJSON-1104291714 tempest-VolumesGetTestJSON-1104291714-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/d969dd52-7c68-4c69-b186-d27c3a734910" status: 404 len: 109 microversion: 2.1 time: 0.077647 Jul 21 17:33:58.755492 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 17:33:58 2022] GET /compute/v2.1/os-volumes/d969dd52-7c68-4c69-b186-d27c3a734910 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 17:34:00.134562 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-21642bfa-0361-4d72-9d9a-ec069ce145c6 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] Calling method '.version_select at 0x7ffa2c341d30>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:00.234521 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-21642bfa-0361-4d72-9d9a-ec069ce145c6 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/ca4ef786-3759-4de1-8830-a1e68371a1a9" status: 200 len: 351 microversion: 2.1 time: 0.104270 Jul 21 17:34:00.235301 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 4/9] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 17:34:00 2022] GET /compute/v2.1/os-volumes/ca4ef786-3759-4de1-8830-a1e68371a1a9 => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:00.248343 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-13cb79ef-f7cd-4e23-8135-f333478a1740 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] Calling method '.version_select at 0x7ffa2c27e310>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:00.693013 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-13cb79ef-f7cd-4e23-8135-f333478a1740 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.449639 Jul 21 17:34:00.694243 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 6/10] 10.222.0.57 () {58 vars in 1133 bytes} [Thu Jul 21 17:34:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:00.710358 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-18230a06-49e8-4ba3-b411-8b9ba5e3736c tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] Calling method '.version_select at 0x7ffa2c3063a0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:00.875087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-18230a06-49e8-4ba3-b411-8b9ba5e3736c tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.169819 Jul 21 17:34:00.883521 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 5/11] 10.222.0.57 () {58 vars in 1148 bytes} [Thu Jul 21 17:34:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:00.889393 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8beb243e-de13-472e-8380-70a7358c24b3 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] Calling method '.version_select at 0x7ffa2cc910d0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:01.169035 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8beb243e-de13-472e-8380-70a7358c24b3 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.284047 Jul 21 17:34:01.170061 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 7/12] 10.222.0.57 () {58 vars in 1133 bytes} [Thu Jul 21 17:34:00 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:01.186352 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5db68d35-0957-4a68-869a-9c477dd578cc tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] Calling method '.version_select at 0x7ffa2c3418b0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:01.369977 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5db68d35-0957-4a68-869a-9c477dd578cc tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.187602 Jul 21 17:34:01.375259 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 6/13] 10.222.0.57 () {58 vars in 1166 bytes} [Thu Jul 21 17:34:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:01.382992 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-45725d21-2c34-4096-89a3-e06dc59e38b1 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] Calling method '.version_select at 0x7ffa2c27e280>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:01.567682 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-45725d21-2c34-4096-89a3-e06dc59e38b1 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.188442 Jul 21 17:34:01.576289 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 8/14] 10.222.0.57 () {58 vars in 1169 bytes} [Thu Jul 21 17:34:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:01.583908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c3f7102d-81cd-453d-8105-a6ead9708de6 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] Calling method '.version_select at 0x7ffa2c3065e0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:01.836268 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c3f7102d-81cd-453d-8105-a6ead9708de6 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.258166 Jul 21 17:34:01.837228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 7/15] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jul 21 17:34:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:01.854158 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ae0bfa9d-b265-43ef-9b9a-4717044eeb79 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] Calling method '.version_select at 0x7ffa2c284700>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:02.130005 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ae0bfa9d-b265-43ef-9b9a-4717044eeb79 tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.284436 Jul 21 17:34:02.130562 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 9/16] 10.222.0.57 () {58 vars in 1187 bytes} [Thu Jul 21 17:34:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:34:02.142736 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e9cfcccc-ea5d-4de5-867c-ace3005aeaba tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] Calling method '.version_select at 0x7ffa2c313430>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:02.359909 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e9cfcccc-ea5d-4de5-867c-ace3005aeaba tempest-VolumesTestJSON-915482506 tempest-VolumesTestJSON-915482506-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.220859 Jul 21 17:34:02.360863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 8/17] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jul 21 17:34:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:05.562433 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fd578121-198b-4e71-a272-94396cd19c3f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Action: 'create', calling method: .version_select at 0x7ffa2c284820>, body: {"keypair": {"name": "tempest-keypair-2028519348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNENnEzlPH3UeE61M8TepTgy1KfjLbkmBiWkBntVwl1rLE7X+h/kBSxx0GwASKNJJgiGAU5mFLmYrkgGYPr9K6kB/9Qr8BP5md0tze0A1OmDwuOX91twnBhLsYhqeivCLw=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:05.699272 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-fd578121-198b-4e71-a272-94396cd19c3f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Getting quotas for project b0917b2a75df4a9ab1d2cbd4fd3f7613. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:34:05.716100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-fd578121-198b-4e71-a272-94396cd19c3f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Getting quotas for user fa82bddf9aa0455797d42993fe850ccf and project b0917b2a75df4a9ab1d2cbd4fd3f7613. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:34:05.857943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fd578121-198b-4e71-a272-94396cd19c3f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.036614 Jul 21 17:34:05.858548 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 10/18] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 17:34:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:13.678895 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fe242b4a-2e12-4067-950f-77fef0af38fd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Action: 'create', calling method: .version_select at 0x7ffa2c306d30>, body: {"keypair": {"name": "tempest-keypair-1940004804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCZuqAdPLBCmLN69AvTRtz9ncI3A2IiGpAJzq1j7jzYqzePzxOMrMejB8wepZDtKdKFWqkxHRUahuw7TxRuPcIimQpFpZD3Mj3V3oHufqrkAHOJcc82J7Da0AI54Kl0Ug=="}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:13.792478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-fe242b4a-2e12-4067-950f-77fef0af38fd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Getting quotas for project 5161720524a4488aa42e383597d30144. Resources: {'key_pairs'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:34:13.807283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-fe242b4a-2e12-4067-950f-77fef0af38fd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Getting quotas for user 2ea3ea36439143b8a55f181170efc14a and project 5161720524a4488aa42e383597d30144. Resources: {'key_pairs'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:34:13.950532 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fe242b4a-2e12-4067-950f-77fef0af38fd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.602375 Jul 21 17:34:13.959658 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 9/19] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 17:34:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:14.582996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-565622964", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "networks": [{"uuid": "280e10dd-dbea-4f7b-a1b0-8faf34d8da75"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:14.805932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] validate_networks() for [('280e10dd-dbea-4f7b-a1b0-8faf34d8da75', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 17:34:15.269835 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1413074935", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06d00d4d-9cae-405b-a67d-dc9e38e8701d"}], "security_groups": [{"name": "tempest-securitygroup--686029961"}], "key_name": "tempest-keypair-2028519348", "user_data": "}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:15.559171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.network.neutron [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] validate_networks() for [('06d00d4d-9cae-405b-a67d-dc9e38e8701d', None, None, None, None, None)] {{(pid=124381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 17:34:15.759735 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:17.577532 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 17:34:17.581494 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 17:34:17.582246 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 17:34:17.582897 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 17:34:17.583525 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 17:34:17.621618 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:17.623243 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:17.625381 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:17.626778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:17.699293 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Flavor limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 17:34:17.699718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Image limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 17:34:17.700194 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Flavor pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 17:34:17.700665 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Image pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 17:34:17.701098 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 17:34:17.710014 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Getting quotas for project f52012c88f1e4cc59092d37fcc0fa23a. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:34:17.721548 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Getting quotas for user c5e836103d274f9386f2dd933acd982d and project f52012c88f1e4cc59092d37fcc0fa23a. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:34:17.723354 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:17.723812 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:17.724656 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:17.725112 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:17.760183 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 17:34:17.764059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 17:34:17.812219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Getting quotas for project b0917b2a75df4a9ab1d2cbd4fd3f7613. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:34:17.830144 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Getting quotas for user fa82bddf9aa0455797d42993fe850ccf and project b0917b2a75df4a9ab1d2cbd4fd3f7613. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:34:17.853005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Going to run 1 instances... {{(pid=124381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 17:34:17.857456 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 17:34:18.016895 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-254f665c-307d-487c-9518-8590e2f2d6d9 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.302485 Jul 21 17:34:18.017950 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 17:34:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 17:34:18.054479 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b9e52952-9438-4a5e-b50e-56baa895c845 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.789896 Jul 21 17:34:18.057939 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 10/21] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 17:34:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 2794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 17:34:18.071169 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-edbdcd18-47d3-43b0-bf66-8a5734b42125 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:18.103417 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-edbdcd18-47d3-43b0-bf66-8a5734b42125 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:18.363543 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-edbdcd18-47d3-43b0-bf66-8a5734b42125 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:18.383403 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-edbdcd18-47d3-43b0-bf66-8a5734b42125 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1214 microversion: 2.1 time: 0.323864 Jul 21 17:34:18.384359 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 11/22] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:18 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1214 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:18.391146 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b1538e28-76bc-4cbd-a362-f0fda43d9229 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:18.392063 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b1538e28-76bc-4cbd-a362-f0fda43d9229 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:18.486087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b1538e28-76bc-4cbd-a362-f0fda43d9229 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:18.496097 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b1538e28-76bc-4cbd-a362-f0fda43d9229 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1242 microversion: 2.1 time: 0.109168 Jul 21 17:34:18.500541 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 12/23] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:18 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:18.742387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1090104147", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:18.864281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] validate_networks() for [('f5e9383e-9fd8-40f6-9210-4c8252ba8c67', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 17:34:19.294646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1239014897", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cd4920e-3d1b-4840-bbfa-5e190c8ab42a"}], "security_groups": [{"name": "tempest-securitygroup--2133639339"}], "key_name": "tempest-keypair-1940004804", "user_data": "}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:19.783105 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.network.neutron [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] validate_networks() for [('4cd4920e-3d1b-4840-bbfa-5e190c8ab42a', None, None, None, None, None)] {{(pid=124381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 17:34:20.753660 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 17:34:20.754184 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 17:34:20.754660 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 17:34:20.755325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 17:34:20.755800 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 17:34:20.781104 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:20.781577 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:20.784711 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:20.786652 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:20.841238 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Getting quotas for project 21c11b3abe754d86919bbcf31ecb312a. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:34:20.856087 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Getting quotas for user 1bf6e7a4afaf405caae7d750973d9956 and project 21c11b3abe754d86919bbcf31ecb312a. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:34:20.882591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 17:34:20.891505 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 17:34:21.019393 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bc9e49f1-1ff1-4f38-b33e-12f2fefed50f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.999775 Jul 21 17:34:21.021977 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 12/24] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 17:34:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 17:34:21.028596 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-725c590d-0486-4831-a2dd-a04264182199 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:21.029588 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-725c590d-0486-4831-a2dd-a04264182199 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:21.073537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-725c590d-0486-4831-a2dd-a04264182199 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:21.080004 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-725c590d-0486-4831-a2dd-a04264182199 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:21.083955 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-725c590d-0486-4831-a2dd-a04264182199 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:21.085306 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-725c590d-0486-4831-a2dd-a04264182199 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:21.187214 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Flavor limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 17:34:21.187813 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Image limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 17:34:21.188590 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Flavor pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 17:34:21.189277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Image pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 17:34:21.190348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 17:34:21.216890 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:21.219613 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:21.221063 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:21.224878 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:21.275320 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Getting quotas for project 5161720524a4488aa42e383597d30144. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:34:21.286025 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Getting quotas for user 2ea3ea36439143b8a55f181170efc14a and project 5161720524a4488aa42e383597d30144. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:34:21.343079 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Going to run 1 instances... {{(pid=124381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 17:34:21.360977 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 17:34:21.453025 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8528aeff-e5da-4b31-b825-dc986b46edab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.171166 Jul 21 17:34:21.454283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 13/25] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 17:34:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 2177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 17:34:21.467161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-79b82911-572f-42aa-bf69-fd12a02ae6ca tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:21.467695 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-79b82911-572f-42aa-bf69-fd12a02ae6ca tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:21.482338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79b82911-572f-42aa-bf69-fd12a02ae6ca tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:21.482876 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79b82911-572f-42aa-bf69-fd12a02ae6ca tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:21.483806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79b82911-572f-42aa-bf69-fd12a02ae6ca tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:21.484407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79b82911-572f-42aa-bf69-fd12a02ae6ca tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:21.676754 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-725c590d-0486-4831-a2dd-a04264182199 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:21.716002 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-725c590d-0486-4831-a2dd-a04264182199 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1266 microversion: 2.1 time: 0.685980 Jul 21 17:34:21.730942 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 13/26] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:21 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1266 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:21.744374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a3ca449-05f4-49ad-afdc-acb40a96f6ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:21.749231 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4a3ca449-05f4-49ad-afdc-acb40a96f6ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:21.784958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-79b82911-572f-42aa-bf69-fd12a02ae6ca tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:21.838008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-79b82911-572f-42aa-bf69-fd12a02ae6ca tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1294 microversion: 2.1 time: 0.376528 Jul 21 17:34:21.848703 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 14/27] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:21 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1294 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:21.883128 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-37b87374-2304-44ea-93c1-c6e6d38ea702 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:21.893055 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-37b87374-2304-44ea-93c1-c6e6d38ea702 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:22.341696 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4a3ca449-05f4-49ad-afdc-acb40a96f6ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:22.373380 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4a3ca449-05f4-49ad-afdc-acb40a96f6ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1222 microversion: 2.1 time: 0.641204 Jul 21 17:34:22.376192 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 14/28] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:21 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1222 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:22.407668 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-37b87374-2304-44ea-93c1-c6e6d38ea702 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:22.420539 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-37b87374-2304-44ea-93c1-c6e6d38ea702 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1238 microversion: 2.1 time: 0.570209 Jul 21 17:34:22.423823 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 15/29] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1238 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:22.735996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-003103fa-fac1-49d4-ae39-8c76598ef511 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:22.736740 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-003103fa-fac1-49d4-ae39-8c76598ef511 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:22.750554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-003103fa-fac1-49d4-ae39-8c76598ef511 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:22.751086 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-003103fa-fac1-49d4-ae39-8c76598ef511 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:22.752004 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-003103fa-fac1-49d4-ae39-8c76598ef511 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:22.752519 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-003103fa-fac1-49d4-ae39-8c76598ef511 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:22.869944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b00b697f-6b15-45f3-b17b-c8a71848da5a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:22.871930 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b00b697f-6b15-45f3-b17b-c8a71848da5a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:22.887727 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b00b697f-6b15-45f3-b17b-c8a71848da5a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:22.901248 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b00b697f-6b15-45f3-b17b-c8a71848da5a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:22.902463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b00b697f-6b15-45f3-b17b-c8a71848da5a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:22.903185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b00b697f-6b15-45f3-b17b-c8a71848da5a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:23.153808 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-003103fa-fac1-49d4-ae39-8c76598ef511 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:23.164159 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-003103fa-fac1-49d4-ae39-8c76598ef511 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1272 microversion: 2.1 time: 0.434439 Jul 21 17:34:23.165268 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 15/30] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:22 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1272 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:23.177779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1938177578", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:23.190270 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b00b697f-6b15-45f3-b17b-c8a71848da5a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:23.215563 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b00b697f-6b15-45f3-b17b-c8a71848da5a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1300 microversion: 2.1 time: 0.348769 Jul 21 17:34:23.216283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 16/31] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:22 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1300 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:23.349240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] validate_networks() for [('f5e9383e-9fd8-40f6-9210-4c8252ba8c67', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 17:34:23.442253 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b53d8704-2ca6-40d9-ba70-8a60af1df856 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:23.443723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b53d8704-2ca6-40d9-ba70-8a60af1df856 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:23.463162 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b53d8704-2ca6-40d9-ba70-8a60af1df856 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:23.464867 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b53d8704-2ca6-40d9-ba70-8a60af1df856 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:23.470810 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b53d8704-2ca6-40d9-ba70-8a60af1df856 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:23.480701 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b53d8704-2ca6-40d9-ba70-8a60af1df856 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:24.478224 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b53d8704-2ca6-40d9-ba70-8a60af1df856 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:24.491703 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b53d8704-2ca6-40d9-ba70-8a60af1df856 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1290 microversion: 2.1 time: 1.054104 Jul 21 17:34:24.496290 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 17/32] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:23 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1290 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:24.511702 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-78053e82-e693-48d6-bdeb-e8583054da64 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:24.515632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-78053e82-e693-48d6-bdeb-e8583054da64 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:24.549159 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-78053e82-e693-48d6-bdeb-e8583054da64 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:24.549159 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-78053e82-e693-48d6-bdeb-e8583054da64 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:24.549159 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-78053e82-e693-48d6-bdeb-e8583054da64 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:24.549159 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-78053e82-e693-48d6-bdeb-e8583054da64 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:25.138777 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-78053e82-e693-48d6-bdeb-e8583054da64 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:25.148150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-78053e82-e693-48d6-bdeb-e8583054da64 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1272 microversion: 2.1 time: 0.650465 Jul 21 17:34:25.153027 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 18/33] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:24 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1272 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:25.158234 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0cb8fef7-00be-4b52-aa73-9622c625f8fe tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:25.165995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0cb8fef7-00be-4b52-aa73-9622c625f8fe tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:25.179185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0cb8fef7-00be-4b52-aa73-9622c625f8fe tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:25.181954 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0cb8fef7-00be-4b52-aa73-9622c625f8fe tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:25.183579 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0cb8fef7-00be-4b52-aa73-9622c625f8fe tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:25.186044 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0cb8fef7-00be-4b52-aa73-9622c625f8fe tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:26.439601 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0cb8fef7-00be-4b52-aa73-9622c625f8fe tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:26.450374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0cb8fef7-00be-4b52-aa73-9622c625f8fe tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 1.294133 Jul 21 17:34:26.462694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 19/34] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:25 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:26.473538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c4f3ff9e-8cc5-4002-8d7c-eb7cddd36c75 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:26.475951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c4f3ff9e-8cc5-4002-8d7c-eb7cddd36c75 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:26.492827 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c4f3ff9e-8cc5-4002-8d7c-eb7cddd36c75 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:26.493407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c4f3ff9e-8cc5-4002-8d7c-eb7cddd36c75 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:26.494271 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c4f3ff9e-8cc5-4002-8d7c-eb7cddd36c75 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:26.494789 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c4f3ff9e-8cc5-4002-8d7c-eb7cddd36c75 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:26.671817 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c4f3ff9e-8cc5-4002-8d7c-eb7cddd36c75 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:26.685177 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 17:34:26.686903 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 17:34:26.686903 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 17:34:26.686903 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 17:34:26.686903 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 17:34:26.696709 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c4f3ff9e-8cc5-4002-8d7c-eb7cddd36c75 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1296 microversion: 2.1 time: 0.232327 Jul 21 17:34:26.697310 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 20/35] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:26 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1296 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:26.720473 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:26.722618 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:26.724379 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:26.726389 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:26.727168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ddbf9776-8bc0-4399-9e3d-a24192235beb tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:26.733105 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ddbf9776-8bc0-4399-9e3d-a24192235beb tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:26.748833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ddbf9776-8bc0-4399-9e3d-a24192235beb tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:26.757096 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ddbf9776-8bc0-4399-9e3d-a24192235beb tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:26.758895 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ddbf9776-8bc0-4399-9e3d-a24192235beb tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:26.765343 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ddbf9776-8bc0-4399-9e3d-a24192235beb tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:26.795911 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Getting quotas for project 21c11b3abe754d86919bbcf31ecb312a. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:34:26.817432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Getting quotas for user 1bf6e7a4afaf405caae7d750973d9956 and project 21c11b3abe754d86919bbcf31ecb312a. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:34:26.845392 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 17:34:26.849353 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 17:34:27.000698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-64933881-3ff6-4ecb-b5be-082c614d095a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.833735 Jul 21 17:34:27.001607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 16/36] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 17:34:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 3836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 17:34:27.019039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-edf35937-fc9b-4d2a-a1d0-d4392773020f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:27.024627 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-edf35937-fc9b-4d2a-a1d0-d4392773020f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:27.496201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-edf35937-fc9b-4d2a-a1d0-d4392773020f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:27.513808 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-edf35937-fc9b-4d2a-a1d0-d4392773020f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1222 microversion: 2.1 time: 0.505802 Jul 21 17:34:27.517936 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 17/37] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:27 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1222 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:27.523784 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4f20b0cd-5d7e-430a-b7bf-a6f21bd13275 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:27.527587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4f20b0cd-5d7e-430a-b7bf-a6f21bd13275 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:27.554307 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4f20b0cd-5d7e-430a-b7bf-a6f21bd13275 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:27.555015 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4f20b0cd-5d7e-430a-b7bf-a6f21bd13275 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:27.558454 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4f20b0cd-5d7e-430a-b7bf-a6f21bd13275 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:27.558945 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4f20b0cd-5d7e-430a-b7bf-a6f21bd13275 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:28.618320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4f20b0cd-5d7e-430a-b7bf-a6f21bd13275 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:28.626410 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4f20b0cd-5d7e-430a-b7bf-a6f21bd13275 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 1.107173 Jul 21 17:34:28.642704 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 18/38] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:27 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:28.664661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-48935bf8-ab6f-4cde-b2bd-e742be08f3f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:28.666781 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-48935bf8-ab6f-4cde-b2bd-e742be08f3f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:28.693604 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48935bf8-ab6f-4cde-b2bd-e742be08f3f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:28.694074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48935bf8-ab6f-4cde-b2bd-e742be08f3f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:28.694964 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48935bf8-ab6f-4cde-b2bd-e742be08f3f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:28.695437 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48935bf8-ab6f-4cde-b2bd-e742be08f3f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:28.718021 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ddbf9776-8bc0-4399-9e3d-a24192235beb tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:28.735172 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ddbf9776-8bc0-4399-9e3d-a24192235beb tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1314 microversion: 2.1 time: 2.021044 Jul 21 17:34:28.752327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 21/39] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:26 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1314 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:28.795906 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-48afaedd-7a1c-49c9-8d26-833ceaeb5df8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:28.797300 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-48afaedd-7a1c-49c9-8d26-833ceaeb5df8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:28.861727 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-48afaedd-7a1c-49c9-8d26-833ceaeb5df8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:28.871605 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-48afaedd-7a1c-49c9-8d26-833ceaeb5df8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:28.878918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-48afaedd-7a1c-49c9-8d26-833ceaeb5df8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:28.881385 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-48afaedd-7a1c-49c9-8d26-833ceaeb5df8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:29.270999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-48afaedd-7a1c-49c9-8d26-833ceaeb5df8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:29.285390 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-48afaedd-7a1c-49c9-8d26-833ceaeb5df8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1274 microversion: 2.1 time: 0.526509 Jul 21 17:34:29.287791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 22/40] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:28 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1274 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:29.660692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ae8455e6-6ae3-4e65-81af-b87ec0dfb5bf tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:29.664459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ae8455e6-6ae3-4e65-81af-b87ec0dfb5bf tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:29.697943 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae8455e6-6ae3-4e65-81af-b87ec0dfb5bf tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:29.699003 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae8455e6-6ae3-4e65-81af-b87ec0dfb5bf tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:29.700090 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae8455e6-6ae3-4e65-81af-b87ec0dfb5bf tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:29.700606 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae8455e6-6ae3-4e65-81af-b87ec0dfb5bf tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:30.204930 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-48935bf8-ab6f-4cde-b2bd-e742be08f3f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:30.220480 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-48935bf8-ab6f-4cde-b2bd-e742be08f3f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 1.576158 Jul 21 17:34:30.221805 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 19/41] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:28 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:30.234539 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f8101910-5f1c-4eab-87bc-a3452bd4b223 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:30.235168 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f8101910-5f1c-4eab-87bc-a3452bd4b223 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:30.277722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f8101910-5f1c-4eab-87bc-a3452bd4b223 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:30.278182 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f8101910-5f1c-4eab-87bc-a3452bd4b223 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:30.279009 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f8101910-5f1c-4eab-87bc-a3452bd4b223 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:30.279453 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f8101910-5f1c-4eab-87bc-a3452bd4b223 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:30.531665 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ae8455e6-6ae3-4e65-81af-b87ec0dfb5bf tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:30.554867 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ae8455e6-6ae3-4e65-81af-b87ec0dfb5bf tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 0.899012 Jul 21 17:34:30.558781 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 23/42] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:29 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:30.586129 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ca1c8719-16c8-4445-b9d4-2418af042c70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:30.590169 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ca1c8719-16c8-4445-b9d4-2418af042c70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:30.608893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ca1c8719-16c8-4445-b9d4-2418af042c70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:30.609641 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ca1c8719-16c8-4445-b9d4-2418af042c70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:30.611010 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ca1c8719-16c8-4445-b9d4-2418af042c70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:30.611684 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ca1c8719-16c8-4445-b9d4-2418af042c70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:31.094611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f8101910-5f1c-4eab-87bc-a3452bd4b223 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:31.102455 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ca1c8719-16c8-4445-b9d4-2418af042c70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:31.107985 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f8101910-5f1c-4eab-87bc-a3452bd4b223 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1314 microversion: 2.1 time: 0.884998 Jul 21 17:34:31.114491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ca1c8719-16c8-4445-b9d4-2418af042c70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1280 microversion: 2.1 time: 0.542911 Jul 21 17:34:31.115365 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 24/43] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:30 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1280 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:31.147157 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 20/44] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:30 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1314 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:31.241610 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-af82ab0f-1e13-46d5-86c1-07d62d49f8e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:31.243561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-af82ab0f-1e13-46d5-86c1-07d62d49f8e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:31.247549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=4 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:31.265060 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-af82ab0f-1e13-46d5-86c1-07d62d49f8e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:31.268357 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-af82ab0f-1e13-46d5-86c1-07d62d49f8e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:31.269746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-af82ab0f-1e13-46d5-86c1-07d62d49f8e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:31.273666 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-af82ab0f-1e13-46d5-86c1-07d62d49f8e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:31.443107 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-2e18c355-fa1b-450d-83fe-54e2df536e26 req-3cc3d96e-c5ef-4319-a2b9-4f0d25bb58c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d609ed27-a097-4130-a95c-8bda2c656a75", "tag": "3bfbe1d0-f339-4c79-b3ee-0c2ee6d55cca"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:31.468714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-2e18c355-fa1b-450d-83fe-54e2df536e26 req-3cc3d96e-c5ef-4319-a2b9-4f0d25bb58c8 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:31.469422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-2e18c355-fa1b-450d-83fe-54e2df536e26 req-3cc3d96e-c5ef-4319-a2b9-4f0d25bb58c8 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:31.493330 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-2e18c355-fa1b-450d-83fe-54e2df536e26 req-3cc3d96e-c5ef-4319-a2b9-4f0d25bb58c8 service nova] Creating event network-changed:3bfbe1d0-f339-4c79-b3ee-0c2ee6d55cca for instance d609ed27-a097-4130-a95c-8bda2c656a75 on hv-cinder-82549 Jul 21 17:34:31.494162 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-2e18c355-fa1b-450d-83fe-54e2df536e26 req-3cc3d96e-c5ef-4319-a2b9-4f0d25bb58c8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 17:34:31.495748 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6f6b4441-6471-4096-a408-b4fd4d755651 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:31.496552 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6f6b4441-6471-4096-a408-b4fd4d755651 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:31.497601 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6f6b4441-6471-4096-a408-b4fd4d755651 None None] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:31.498292 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6f6b4441-6471-4096-a408-b4fd4d755651 None None] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:31.511595 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.compute.rpcapi [None req-6f6b4441-6471-4096-a408-b4fd4d755651 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 17:34:31.513374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6f6b4441-6471-4096-a408-b4fd4d755651 None None] Releasing lock "compute-rpcapi-router" {{(pid=124381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 17:34:31.546104 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6f6b4441-6471-4096-a408-b4fd4d755651 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.429289 Jul 21 17:34:31.549233 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 25/45] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:31.652471 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-3e86ec67-c83c-4aba-855a-39cb7cae9536 req-603ad534-7032-47dd-a489-f80901e4683f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da2560b-0f95-4dac-9745-d34cecc16575", "tag": "83ce89a6-6dd2-4dd5-abf5-d6c811684318"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:31.674060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-3e86ec67-c83c-4aba-855a-39cb7cae9536 req-603ad534-7032-47dd-a489-f80901e4683f service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:31.675146 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-3e86ec67-c83c-4aba-855a-39cb7cae9536 req-603ad534-7032-47dd-a489-f80901e4683f service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:31.710322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-3e86ec67-c83c-4aba-855a-39cb7cae9536 req-603ad534-7032-47dd-a489-f80901e4683f service nova] Creating event network-changed:83ce89a6-6dd2-4dd5-abf5-d6c811684318 for instance 2da2560b-0f95-4dac-9745-d34cecc16575 on hv-cinder-82549 Jul 21 17:34:31.731477 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-3e86ec67-c83c-4aba-855a-39cb7cae9536 req-603ad534-7032-47dd-a489-f80901e4683f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178628 Jul 21 17:34:31.734628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 26/46] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:31.746776 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3f326345-2240-43fa-8cbc-b9d92654b1e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:31.748322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3f326345-2240-43fa-8cbc-b9d92654b1e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:31.756464 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f326345-2240-43fa-8cbc-b9d92654b1e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:31.757777 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f326345-2240-43fa-8cbc-b9d92654b1e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:31.759104 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f326345-2240-43fa-8cbc-b9d92654b1e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:31.759711 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f326345-2240-43fa-8cbc-b9d92654b1e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:32.266998 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3f326345-2240-43fa-8cbc-b9d92654b1e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:32.287708 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3f326345-2240-43fa-8cbc-b9d92654b1e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 0.547626 Jul 21 17:34:32.289843 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 27/47] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:31 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:32.302534 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cedd6eb0-9935-4126-a245-47b7d9c407ae tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:32.307424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cedd6eb0-9935-4126-a245-47b7d9c407ae tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:32.329313 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cedd6eb0-9935-4126-a245-47b7d9c407ae tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:32.330737 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cedd6eb0-9935-4126-a245-47b7d9c407ae tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:32.333202 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cedd6eb0-9935-4126-a245-47b7d9c407ae tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:32.334923 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cedd6eb0-9935-4126-a245-47b7d9c407ae tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:32.418499 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=22 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:32.600356 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-af82ab0f-1e13-46d5-86c1-07d62d49f8e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:32.628927 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-af82ab0f-1e13-46d5-86c1-07d62d49f8e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 1.393322 Jul 21 17:34:32.633954 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 21/48] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:32.651372 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b4712ed1-7e32-45c9-8d3f-3d1e67785e47 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:32.652024 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b4712ed1-7e32-45c9-8d3f-3d1e67785e47 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:32.685294 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4712ed1-7e32-45c9-8d3f-3d1e67785e47 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:32.689402 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4712ed1-7e32-45c9-8d3f-3d1e67785e47 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:32.693104 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4712ed1-7e32-45c9-8d3f-3d1e67785e47 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:32.695663 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4712ed1-7e32-45c9-8d3f-3d1e67785e47 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:33.176477 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b4712ed1-7e32-45c9-8d3f-3d1e67785e47 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:33.193606 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b4712ed1-7e32-45c9-8d3f-3d1e67785e47 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1280 microversion: 2.1 time: 0.556309 Jul 21 17:34:33.196672 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 22/49] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:32 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1280 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:33.308714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-02869f18-606e-4b0a-95fe-be863af37499 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:33.309361 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-02869f18-606e-4b0a-95fe-be863af37499 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:33.327167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02869f18-606e-4b0a-95fe-be863af37499 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:33.327644 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02869f18-606e-4b0a-95fe-be863af37499 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:33.328529 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02869f18-606e-4b0a-95fe-be863af37499 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:33.329018 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02869f18-606e-4b0a-95fe-be863af37499 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:34.063710 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-cedd6eb0-9935-4126-a245-47b7d9c407ae tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:34.074826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cedd6eb0-9935-4126-a245-47b7d9c407ae tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1314 microversion: 2.1 time: 1.783679 Jul 21 17:34:34.083921 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 28/50] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:32 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1314 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:34.097228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-a3a3eba8-f765-4827-8a4e-12f45e411bee req-026ec966-b3a3-4fc1-9ef4-2b43f674ae75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff28a98-a8bf-43c7-ad64-2b693c0d419e", "tag": "79e6e077-66c3-4d54-9164-1c97dd9c881c"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:34.137192 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-a3a3eba8-f765-4827-8a4e-12f45e411bee req-026ec966-b3a3-4fc1-9ef4-2b43f674ae75 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:34.140746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-a3a3eba8-f765-4827-8a4e-12f45e411bee req-026ec966-b3a3-4fc1-9ef4-2b43f674ae75 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:34.169311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-a3a3eba8-f765-4827-8a4e-12f45e411bee req-026ec966-b3a3-4fc1-9ef4-2b43f674ae75 service nova] Creating event network-changed:79e6e077-66c3-4d54-9164-1c97dd9c881c for instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e on hv-cinder-82549 Jul 21 17:34:34.187436 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-a3a3eba8-f765-4827-8a4e-12f45e411bee req-026ec966-b3a3-4fc1-9ef4-2b43f674ae75 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100353 Jul 21 17:34:34.188728 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 29/51] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:34.216225 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-95d29ae5-803a-4c61-b3d8-af0129fcc892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:34.217638 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-95d29ae5-803a-4c61-b3d8-af0129fcc892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:34.249731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-95d29ae5-803a-4c61-b3d8-af0129fcc892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:34.250470 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-95d29ae5-803a-4c61-b3d8-af0129fcc892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:34.253557 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-95d29ae5-803a-4c61-b3d8-af0129fcc892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:34.255288 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-95d29ae5-803a-4c61-b3d8-af0129fcc892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:34.764736 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-02869f18-606e-4b0a-95fe-be863af37499 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:34.778769 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-02869f18-606e-4b0a-95fe-be863af37499 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 1.475613 Jul 21 17:34:34.781467 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 23/52] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:33 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:34.797605 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-97a92dd2-6ec9-4268-a81c-a6f5adb53614 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:34.801125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-97a92dd2-6ec9-4268-a81c-a6f5adb53614 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:34.820214 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97a92dd2-6ec9-4268-a81c-a6f5adb53614 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:34.821051 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97a92dd2-6ec9-4268-a81c-a6f5adb53614 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:34.823394 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97a92dd2-6ec9-4268-a81c-a6f5adb53614 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:34.824876 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97a92dd2-6ec9-4268-a81c-a6f5adb53614 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:34.975580 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-95d29ae5-803a-4c61-b3d8-af0129fcc892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:34.985805 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-95d29ae5-803a-4c61-b3d8-af0129fcc892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 0.795691 Jul 21 17:34:34.988359 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 30/53] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:34 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:35.101436 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6efc0628-b442-4dec-b9dd-35f6a2317a6b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:35.102203 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6efc0628-b442-4dec-b9dd-35f6a2317a6b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:35.113853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6efc0628-b442-4dec-b9dd-35f6a2317a6b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:35.116220 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6efc0628-b442-4dec-b9dd-35f6a2317a6b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:35.117338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6efc0628-b442-4dec-b9dd-35f6a2317a6b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:35.119171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6efc0628-b442-4dec-b9dd-35f6a2317a6b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:35.439188 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6efc0628-b442-4dec-b9dd-35f6a2317a6b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:35.450625 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6efc0628-b442-4dec-b9dd-35f6a2317a6b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1314 microversion: 2.1 time: 0.353312 Jul 21 17:34:35.453210 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 31/54] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:35 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:35.470123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-792390cf-9602-4f4a-a991-f4c6c048ccbb req-2a482a8b-2fe0-469e-a5d2-6e9c2141c0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b7093e-b70d-4a59-bc9a-e08264c48761", "tag": "f6f5a2be-a21c-4d5e-8942-24180cec25a3"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:35.483677 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-97a92dd2-6ec9-4268-a81c-a6f5adb53614 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:35.496592 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-97a92dd2-6ec9-4268-a81c-a6f5adb53614 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.713706 Jul 21 17:34:35.502276 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-792390cf-9602-4f4a-a991-f4c6c048ccbb req-2a482a8b-2fe0-469e-a5d2-6e9c2141c0d2 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:35.502729 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-792390cf-9602-4f4a-a991-f4c6c048ccbb req-2a482a8b-2fe0-469e-a5d2-6e9c2141c0d2 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:35.507760 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 24/55] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:34 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:35.515008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-792390cf-9602-4f4a-a991-f4c6c048ccbb req-2a482a8b-2fe0-469e-a5d2-6e9c2141c0d2 service nova] Creating event network-changed:f6f5a2be-a21c-4d5e-8942-24180cec25a3 for instance f2b7093e-b70d-4a59-bc9a-e08264c48761 on hv-cinder-82549 Jul 21 17:34:35.520057 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-792390cf-9602-4f4a-a991-f4c6c048ccbb req-2a482a8b-2fe0-469e-a5d2-6e9c2141c0d2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063879 Jul 21 17:34:35.521066 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 32/56] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:35.799057 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5f55d06a-e098-4436-b4d3-06e09a7ea6d3 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:35.800477 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5f55d06a-e098-4436-b4d3-06e09a7ea6d3 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:35.807474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=10 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:35.809602 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5f55d06a-e098-4436-b4d3-06e09a7ea6d3 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:35.810333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5f55d06a-e098-4436-b4d3-06e09a7ea6d3 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:35.811386 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5f55d06a-e098-4436-b4d3-06e09a7ea6d3 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:35.812047 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5f55d06a-e098-4436-b4d3-06e09a7ea6d3 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:36.009322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5544689f-f6b3-47c8-b80e-ecb19cfc06a7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:36.010460 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5544689f-f6b3-47c8-b80e-ecb19cfc06a7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:36.018715 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5544689f-f6b3-47c8-b80e-ecb19cfc06a7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:36.019425 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5544689f-f6b3-47c8-b80e-ecb19cfc06a7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:36.021214 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5544689f-f6b3-47c8-b80e-ecb19cfc06a7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:36.022408 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5544689f-f6b3-47c8-b80e-ecb19cfc06a7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:36.066663 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=100 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:36.214102 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5f55d06a-e098-4436-b4d3-06e09a7ea6d3 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:36.225114 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5f55d06a-e098-4436-b4d3-06e09a7ea6d3 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 0.428278 Jul 21 17:34:36.225922 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 25/57] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:35 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:36.394079 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5544689f-f6b3-47c8-b80e-ecb19cfc06a7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:36.405957 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5544689f-f6b3-47c8-b80e-ecb19cfc06a7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 0.401164 Jul 21 17:34:36.407282 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 33/58] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:36 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:36.474825 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ce65253f-ac75-41a1-a92f-a188dcca4f70 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:36.475699 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ce65253f-ac75-41a1-a92f-a188dcca4f70 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:36.493602 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce65253f-ac75-41a1-a92f-a188dcca4f70 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:36.494060 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce65253f-ac75-41a1-a92f-a188dcca4f70 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:36.497622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce65253f-ac75-41a1-a92f-a188dcca4f70 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:36.498423 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce65253f-ac75-41a1-a92f-a188dcca4f70 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:36.517421 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fbfc9144-5f5f-4b93-a36c-23d9a54d55cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:36.519318 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fbfc9144-5f5f-4b93-a36c-23d9a54d55cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:36.530146 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:36.535573 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fbfc9144-5f5f-4b93-a36c-23d9a54d55cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:36.540277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fbfc9144-5f5f-4b93-a36c-23d9a54d55cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:36.546741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fbfc9144-5f5f-4b93-a36c-23d9a54d55cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:36.547215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fbfc9144-5f5f-4b93-a36c-23d9a54d55cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:36.754426 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:36.887576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ce65253f-ac75-41a1-a92f-a188dcca4f70 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:36.901904 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-fbfc9144-5f5f-4b93-a36c-23d9a54d55cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:36.903606 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ce65253f-ac75-41a1-a92f-a188dcca4f70 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1314 microversion: 2.1 time: 0.432550 Jul 21 17:34:36.906818 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 26/59] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:36 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:36.921848 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-507022e6-cb60-415b-b39b-05e89de4e08e req-652c2acd-3dfa-4ac2-b59b-c671c5c6931b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "763d9b30-7ec8-42e4-9a88-2b7ff3a771cd", "tag": "34e81461-bec9-492f-a85f-2fc89ebdc164"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:36.940566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-507022e6-cb60-415b-b39b-05e89de4e08e req-652c2acd-3dfa-4ac2-b59b-c671c5c6931b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:36.941267 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-507022e6-cb60-415b-b39b-05e89de4e08e req-652c2acd-3dfa-4ac2-b59b-c671c5c6931b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:36.943452 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fbfc9144-5f5f-4b93-a36c-23d9a54d55cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.433646 Jul 21 17:34:36.953629 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 34/60] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:36 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:36.984092 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-507022e6-cb60-415b-b39b-05e89de4e08e req-652c2acd-3dfa-4ac2-b59b-c671c5c6931b service nova] Creating event network-changed:34e81461-bec9-492f-a85f-2fc89ebdc164 for instance 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd on hv-cinder-82549 Jul 21 17:34:36.984622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-507022e6-cb60-415b-b39b-05e89de4e08e req-652c2acd-3dfa-4ac2-b59b-c671c5c6931b service nova] Acquired lock "compute-rpcapi-router" {{(pid=124380) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 17:34:36.986343 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aff4f7c5-b221-4558-a89b-ed3d28f98d72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:36.986921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aff4f7c5-b221-4558-a89b-ed3d28f98d72 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:36.987993 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aff4f7c5-b221-4558-a89b-ed3d28f98d72 None None] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:36.988779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aff4f7c5-b221-4558-a89b-ed3d28f98d72 None None] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:37.008231 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.compute.rpcapi [None req-aff4f7c5-b221-4558-a89b-ed3d28f98d72 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 17:34:37.009392 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aff4f7c5-b221-4558-a89b-ed3d28f98d72 None None] Releasing lock "compute-rpcapi-router" {{(pid=124380) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 17:34:37.039140 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-aff4f7c5-b221-4558-a89b-ed3d28f98d72 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129810 Jul 21 17:34:37.040561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 27/61] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:37.248904 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fa48bc25-ee5c-4466-b002-e630086061f8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:37.250610 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fa48bc25-ee5c-4466-b002-e630086061f8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:37.258021 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fa48bc25-ee5c-4466-b002-e630086061f8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:37.258475 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fa48bc25-ee5c-4466-b002-e630086061f8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:37.259537 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fa48bc25-ee5c-4466-b002-e630086061f8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:37.259971 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fa48bc25-ee5c-4466-b002-e630086061f8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:37.425695 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5ece245c-f590-4930-b470-a2461db0500a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:37.426413 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5ece245c-f590-4930-b470-a2461db0500a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:37.431850 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-fa48bc25-ee5c-4466-b002-e630086061f8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:37.436950 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ece245c-f590-4930-b470-a2461db0500a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:37.437405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ece245c-f590-4930-b470-a2461db0500a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:37.439794 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fa48bc25-ee5c-4466-b002-e630086061f8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 0.200270 Jul 21 17:34:37.440838 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 35/62] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:37 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:37.446951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ece245c-f590-4930-b470-a2461db0500a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:37.447410 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ece245c-f590-4930-b470-a2461db0500a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:37.500924 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=22 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:37.778107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5ece245c-f590-4930-b470-a2461db0500a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:37.785870 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5ece245c-f590-4930-b470-a2461db0500a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 0.366301 Jul 21 17:34:37.786884 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 28/63] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:37 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:37.924128 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8f3fa779-66f4-4b72-81a3-59449d1feafe tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:37.925006 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8f3fa779-66f4-4b72-81a3-59449d1feafe tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:37.940507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8f3fa779-66f4-4b72-81a3-59449d1feafe tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:37.941306 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8f3fa779-66f4-4b72-81a3-59449d1feafe tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:37.942773 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8f3fa779-66f4-4b72-81a3-59449d1feafe tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:37.943597 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8f3fa779-66f4-4b72-81a3-59449d1feafe tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:37.965032 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fa841ddb-fd0b-459a-b4af-ee8455ea8bf5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:37.966377 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fa841ddb-fd0b-459a-b4af-ee8455ea8bf5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:37.977736 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa841ddb-fd0b-459a-b4af-ee8455ea8bf5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:37.981662 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa841ddb-fd0b-459a-b4af-ee8455ea8bf5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:37.982853 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa841ddb-fd0b-459a-b4af-ee8455ea8bf5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:37.983531 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa841ddb-fd0b-459a-b4af-ee8455ea8bf5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:38.757560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8f3fa779-66f4-4b72-81a3-59449d1feafe tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:38.766264 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8f3fa779-66f4-4b72-81a3-59449d1feafe tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1314 microversion: 2.1 time: 0.846507 Jul 21 17:34:38.775632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 36/64] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:37 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1314 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:38.780534 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-621a06fa-fc8e-4c48-b92f-1da0f828616c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:38.781356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-621a06fa-fc8e-4c48-b92f-1da0f828616c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:38.786778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fa841ddb-fd0b-459a-b4af-ee8455ea8bf5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:38.793506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-621a06fa-fc8e-4c48-b92f-1da0f828616c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:38.793972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-621a06fa-fc8e-4c48-b92f-1da0f828616c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:38.794769 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-621a06fa-fc8e-4c48-b92f-1da0f828616c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:38.795212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-621a06fa-fc8e-4c48-b92f-1da0f828616c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:38.800959 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fa841ddb-fd0b-459a-b4af-ee8455ea8bf5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.843461 Jul 21 17:34:38.802614 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 29/65] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:37 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:38.828907 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-63917554-3f58-4429-a159-ebc6ba015af4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:38.831543 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-63917554-3f58-4429-a159-ebc6ba015af4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:38.848004 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63917554-3f58-4429-a159-ebc6ba015af4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:38.848615 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63917554-3f58-4429-a159-ebc6ba015af4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:38.849767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63917554-3f58-4429-a159-ebc6ba015af4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:38.850399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63917554-3f58-4429-a159-ebc6ba015af4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:39.281918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-621a06fa-fc8e-4c48-b92f-1da0f828616c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:39.304453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-621a06fa-fc8e-4c48-b92f-1da0f828616c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 0.527423 Jul 21 17:34:39.311056 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 37/66] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:38 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:39.461179 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-63917554-3f58-4429-a159-ebc6ba015af4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:39.476833 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-63917554-3f58-4429-a159-ebc6ba015af4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 0.670782 Jul 21 17:34:39.489284 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 30/67] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:38 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:39.790846 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e761e443-c020-4f26-bc91-2c23bd2ca1b4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:39.791688 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e761e443-c020-4f26-bc91-2c23bd2ca1b4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:39.803226 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e761e443-c020-4f26-bc91-2c23bd2ca1b4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:39.803959 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e761e443-c020-4f26-bc91-2c23bd2ca1b4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:39.804983 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e761e443-c020-4f26-bc91-2c23bd2ca1b4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:39.805703 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e761e443-c020-4f26-bc91-2c23bd2ca1b4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:39.819506 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-39e2f46c-7a22-474e-94e6-c60d255208f7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:39.820361 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-39e2f46c-7a22-474e-94e6-c60d255208f7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:39.838721 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39e2f46c-7a22-474e-94e6-c60d255208f7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:39.839276 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39e2f46c-7a22-474e-94e6-c60d255208f7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:39.840094 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39e2f46c-7a22-474e-94e6-c60d255208f7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:39.840540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39e2f46c-7a22-474e-94e6-c60d255208f7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:40.059833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e761e443-c020-4f26-bc91-2c23bd2ca1b4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:40.068662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e761e443-c020-4f26-bc91-2c23bd2ca1b4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1314 microversion: 2.1 time: 0.281427 Jul 21 17:34:40.070201 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 38/68] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:39 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:40.121318 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-39e2f46c-7a22-474e-94e6-c60d255208f7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:40.125573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:40.131949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-39e2f46c-7a22-474e-94e6-c60d255208f7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.316277 Jul 21 17:34:40.140905 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 31/69] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:39 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:40.329396 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-404526c3-d59d-4e87-a4ee-0c37de8f808d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:40.331397 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-404526c3-d59d-4e87-a4ee-0c37de8f808d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:40.343508 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-404526c3-d59d-4e87-a4ee-0c37de8f808d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:40.344208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-404526c3-d59d-4e87-a4ee-0c37de8f808d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:40.345173 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-404526c3-d59d-4e87-a4ee-0c37de8f808d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:40.345770 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-404526c3-d59d-4e87-a4ee-0c37de8f808d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:40.498749 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e28a31a9-3a6c-4d2e-9dd0-3194d3234704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:40.499479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e28a31a9-3a6c-4d2e-9dd0-3194d3234704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:40.511468 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e28a31a9-3a6c-4d2e-9dd0-3194d3234704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:40.514164 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e28a31a9-3a6c-4d2e-9dd0-3194d3234704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:40.517295 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e28a31a9-3a6c-4d2e-9dd0-3194d3234704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:40.517295 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e28a31a9-3a6c-4d2e-9dd0-3194d3234704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:40.786233 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-404526c3-d59d-4e87-a4ee-0c37de8f808d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:40.799962 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-404526c3-d59d-4e87-a4ee-0c37de8f808d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 0.475010 Jul 21 17:34:40.813655 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 39/70] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:40 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:40.878728 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e28a31a9-3a6c-4d2e-9dd0-3194d3234704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:40.886691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e28a31a9-3a6c-4d2e-9dd0-3194d3234704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 0.394855 Jul 21 17:34:40.887265 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 32/71] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:41.087327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b11549ed-dbca-415a-80b1-92e9c409517f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:41.087944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b11549ed-dbca-415a-80b1-92e9c409517f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:41.097072 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b11549ed-dbca-415a-80b1-92e9c409517f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:41.097762 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b11549ed-dbca-415a-80b1-92e9c409517f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:41.098784 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b11549ed-dbca-415a-80b1-92e9c409517f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:41.099480 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b11549ed-dbca-415a-80b1-92e9c409517f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:41.155055 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7e6c878e-05d3-44a7-bac4-d89ab573e60b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:41.156077 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7e6c878e-05d3-44a7-bac4-d89ab573e60b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:41.169578 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e6c878e-05d3-44a7-bac4-d89ab573e60b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:41.170773 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e6c878e-05d3-44a7-bac4-d89ab573e60b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:41.173564 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e6c878e-05d3-44a7-bac4-d89ab573e60b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:41.174989 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e6c878e-05d3-44a7-bac4-d89ab573e60b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:41.450669 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b11549ed-dbca-415a-80b1-92e9c409517f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:41.472888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b11549ed-dbca-415a-80b1-92e9c409517f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1314 microversion: 2.1 time: 0.386700 Jul 21 17:34:41.473378 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7e6c878e-05d3-44a7-bac4-d89ab573e60b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:41.483293 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7e6c878e-05d3-44a7-bac4-d89ab573e60b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.338530 Jul 21 17:34:41.483906 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 40/72] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:41 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:41.487043 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 33/73] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:41 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:41.819174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3eab91db-368b-40dc-9d70-b9298a31eaed tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:41.819909 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3eab91db-368b-40dc-9d70-b9298a31eaed tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:41.822072 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:41.832999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3eab91db-368b-40dc-9d70-b9298a31eaed tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:41.839571 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3eab91db-368b-40dc-9d70-b9298a31eaed tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:41.842161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3eab91db-368b-40dc-9d70-b9298a31eaed tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:41.845260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3eab91db-368b-40dc-9d70-b9298a31eaed tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:41.906503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0aa409e1-cd17-494e-a244-39ee8ad4f9ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:41.907818 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0aa409e1-cd17-494e-a244-39ee8ad4f9ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:41.922870 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0aa409e1-cd17-494e-a244-39ee8ad4f9ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:41.937740 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0aa409e1-cd17-494e-a244-39ee8ad4f9ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:41.940133 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0aa409e1-cd17-494e-a244-39ee8ad4f9ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:41.942226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0aa409e1-cd17-494e-a244-39ee8ad4f9ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:42.336748 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3eab91db-368b-40dc-9d70-b9298a31eaed tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:42.349269 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3eab91db-368b-40dc-9d70-b9298a31eaed tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 0.532148 Jul 21 17:34:42.356646 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0aa409e1-cd17-494e-a244-39ee8ad4f9ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:42.359691 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 41/74] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:41 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:42.365174 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0aa409e1-cd17-494e-a244-39ee8ad4f9ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 0.462949 Jul 21 17:34:42.378495 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 34/75] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:41 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:42.434343 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-2fcd7645-6576-4c0f-aed5-4a690be38fb6 req-8557fbb9-713f-4532-986d-c4367e43ae2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d609ed27-a097-4130-a95c-8bda2c656a75", "name": "network-vif-plugged", "status": "completed", "tag": "3bfbe1d0-f339-4c79-b3ee-0c2ee6d55cca"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:42.444239 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-2fcd7645-6576-4c0f-aed5-4a690be38fb6 req-8557fbb9-713f-4532-986d-c4367e43ae2a service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:42.444754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-2fcd7645-6576-4c0f-aed5-4a690be38fb6 req-8557fbb9-713f-4532-986d-c4367e43ae2a service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:42.457908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-2fcd7645-6576-4c0f-aed5-4a690be38fb6 req-8557fbb9-713f-4532-986d-c4367e43ae2a service nova] Creating event network-vif-plugged:3bfbe1d0-f339-4c79-b3ee-0c2ee6d55cca for instance d609ed27-a097-4130-a95c-8bda2c656a75 on hv-cinder-82549 Jul 21 17:34:42.463056 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-2fcd7645-6576-4c0f-aed5-4a690be38fb6 req-8557fbb9-713f-4532-986d-c4367e43ae2a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101829 Jul 21 17:34:42.464703 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 42/76] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:42.491340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-805ddd28-36cb-443c-9ddd-d0188bdc8ff1 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:42.492083 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-805ddd28-36cb-443c-9ddd-d0188bdc8ff1 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:42.512508 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-805ddd28-36cb-443c-9ddd-d0188bdc8ff1 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:42.512979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-805ddd28-36cb-443c-9ddd-d0188bdc8ff1 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:42.513827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-805ddd28-36cb-443c-9ddd-d0188bdc8ff1 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:42.514205 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-805ddd28-36cb-443c-9ddd-d0188bdc8ff1 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:42.521321 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-45b97961-663d-499d-8ef5-8342532e6fe1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:42.522028 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-45b97961-663d-499d-8ef5-8342532e6fe1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:42.529175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-45b97961-663d-499d-8ef5-8342532e6fe1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:42.530022 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-45b97961-663d-499d-8ef5-8342532e6fe1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:42.530960 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-45b97961-663d-499d-8ef5-8342532e6fe1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:42.531735 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-45b97961-663d-499d-8ef5-8342532e6fe1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:42.741963 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-805ddd28-36cb-443c-9ddd-d0188bdc8ff1 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:42.751952 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-805ddd28-36cb-443c-9ddd-d0188bdc8ff1 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1314 microversion: 2.1 time: 0.264727 Jul 21 17:34:42.758685 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 35/77] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:42 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:42.790965 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-45b97961-663d-499d-8ef5-8342532e6fe1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:42.800036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-45b97961-663d-499d-8ef5-8342532e6fe1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.282855 Jul 21 17:34:42.800652 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 43/78] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:42 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:43.368133 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-934e2b3b-2d6c-4752-8f0a-495c73f77647 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:43.368823 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-934e2b3b-2d6c-4752-8f0a-495c73f77647 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:43.376718 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-934e2b3b-2d6c-4752-8f0a-495c73f77647 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:43.377173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-934e2b3b-2d6c-4752-8f0a-495c73f77647 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:43.377943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-934e2b3b-2d6c-4752-8f0a-495c73f77647 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:43.378381 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-934e2b3b-2d6c-4752-8f0a-495c73f77647 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:43.384947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-78317510-a1d5-4c5a-a1b2-4cfc58467145 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:43.386282 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-78317510-a1d5-4c5a-a1b2-4cfc58467145 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:43.393008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-78317510-a1d5-4c5a-a1b2-4cfc58467145 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:43.393667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-78317510-a1d5-4c5a-a1b2-4cfc58467145 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:43.394901 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-78317510-a1d5-4c5a-a1b2-4cfc58467145 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:43.396258 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-78317510-a1d5-4c5a-a1b2-4cfc58467145 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:43.835590 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-934e2b3b-2d6c-4752-8f0a-495c73f77647 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:43.852257 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-934e2b3b-2d6c-4752-8f0a-495c73f77647 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 0.488272 Jul 21 17:34:43.862659 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 36/79] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:43 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:43.868723 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0f874133-8925-40f3-a304-6e02056a4b63 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:43.869883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0f874133-8925-40f3-a304-6e02056a4b63 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:43.872503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-78317510-a1d5-4c5a-a1b2-4cfc58467145 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:43.876865 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f874133-8925-40f3-a304-6e02056a4b63 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:43.877500 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f874133-8925-40f3-a304-6e02056a4b63 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:43.878441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f874133-8925-40f3-a304-6e02056a4b63 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:43.879110 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f874133-8925-40f3-a304-6e02056a4b63 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:43.882937 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-78317510-a1d5-4c5a-a1b2-4cfc58467145 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 0.502073 Jul 21 17:34:43.883883 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 44/80] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:43.889686 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f80c015b-920d-438e-b179-25746b3db291 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:43.890839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f80c015b-920d-438e-b179-25746b3db291 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:43.898952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f80c015b-920d-438e-b179-25746b3db291 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:43.899924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f80c015b-920d-438e-b179-25746b3db291 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:43.902136 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f80c015b-920d-438e-b179-25746b3db291 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:43.902808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f80c015b-920d-438e-b179-25746b3db291 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:44.248494 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f80c015b-920d-438e-b179-25746b3db291 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:44.257496 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f80c015b-920d-438e-b179-25746b3db291 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.371967 Jul 21 17:34:44.258319 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 45/81] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:43 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:44.263493 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0f874133-8925-40f3-a304-6e02056a4b63 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:44.277751 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0f874133-8925-40f3-a304-6e02056a4b63 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1314 microversion: 2.1 time: 0.413359 Jul 21 17:34:44.279048 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 37/82] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:43 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:44.482499 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-9e13dd1a-0789-40a0-915d-a46a62dd9ffb req-53b7ece7-33ce-4737-957c-4fe89480d6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da2560b-0f95-4dac-9745-d34cecc16575", "name": "network-vif-plugged", "status": "completed", "tag": "83ce89a6-6dd2-4dd5-abf5-d6c811684318"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:44.491471 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-9e13dd1a-0789-40a0-915d-a46a62dd9ffb req-53b7ece7-33ce-4737-957c-4fe89480d6e5 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:44.492007 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-9e13dd1a-0789-40a0-915d-a46a62dd9ffb req-53b7ece7-33ce-4737-957c-4fe89480d6e5 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:44.505230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-9e13dd1a-0789-40a0-915d-a46a62dd9ffb req-53b7ece7-33ce-4737-957c-4fe89480d6e5 service nova] Creating event network-vif-plugged:83ce89a6-6dd2-4dd5-abf5-d6c811684318 for instance 2da2560b-0f95-4dac-9745-d34cecc16575 on hv-cinder-82549 Jul 21 17:34:44.511722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-9e13dd1a-0789-40a0-915d-a46a62dd9ffb req-53b7ece7-33ce-4737-957c-4fe89480d6e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031729 Jul 21 17:34:44.515547 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 46/83] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:44.873962 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-678f4f2d-617b-4759-84ce-1d660a9cb62b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:44.875592 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-678f4f2d-617b-4759-84ce-1d660a9cb62b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:44.889745 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-678f4f2d-617b-4759-84ce-1d660a9cb62b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:44.890210 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-678f4f2d-617b-4759-84ce-1d660a9cb62b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:44.890995 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-678f4f2d-617b-4759-84ce-1d660a9cb62b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:44.891442 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-678f4f2d-617b-4759-84ce-1d660a9cb62b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:44.900214 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f7f28a52-2de2-4fcd-a464-a529bb35b71b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:44.903865 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f7f28a52-2de2-4fcd-a464-a529bb35b71b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:44.924942 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f7f28a52-2de2-4fcd-a464-a529bb35b71b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:44.925407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f7f28a52-2de2-4fcd-a464-a529bb35b71b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:44.926210 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f7f28a52-2de2-4fcd-a464-a529bb35b71b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:44.926656 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f7f28a52-2de2-4fcd-a464-a529bb35b71b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:45.297221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f7f28a52-2de2-4fcd-a464-a529bb35b71b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:45.307129 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f7f28a52-2de2-4fcd-a464-a529bb35b71b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 0.411114 Jul 21 17:34:45.309890 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 47/84] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:44 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:45.320568 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2db4a575-62e7-4438-9b19-73a3a993af11 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:45.322544 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2db4a575-62e7-4438-9b19-73a3a993af11 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:45.335805 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2db4a575-62e7-4438-9b19-73a3a993af11 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:45.336885 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2db4a575-62e7-4438-9b19-73a3a993af11 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:45.342523 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2db4a575-62e7-4438-9b19-73a3a993af11 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:45.343193 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2db4a575-62e7-4438-9b19-73a3a993af11 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:45.375342 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-678f4f2d-617b-4759-84ce-1d660a9cb62b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:45.383019 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-678f4f2d-617b-4759-84ce-1d660a9cb62b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 0.517298 Jul 21 17:34:45.383606 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 38/85] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:44 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:45.418519 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3a7d6d78-7262-4771-b762-25b42d4be47b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:45.420718 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3a7d6d78-7262-4771-b762-25b42d4be47b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:45.440755 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a7d6d78-7262-4771-b762-25b42d4be47b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:45.441239 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a7d6d78-7262-4771-b762-25b42d4be47b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:45.449196 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a7d6d78-7262-4771-b762-25b42d4be47b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:45.450328 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a7d6d78-7262-4771-b762-25b42d4be47b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:45.764208 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3a7d6d78-7262-4771-b762-25b42d4be47b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:45.778897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2db4a575-62e7-4438-9b19-73a3a993af11 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:45.787281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3a7d6d78-7262-4771-b762-25b42d4be47b tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1314 microversion: 2.1 time: 0.395540 Jul 21 17:34:45.792005 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 39/86] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:45 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:45.794739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2db4a575-62e7-4438-9b19-73a3a993af11 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.483100 Jul 21 17:34:45.797946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 48/87] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:45 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:46.336499 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c1880153-ee2e-4476-b0ee-079d04cd77e6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:46.339345 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c1880153-ee2e-4476-b0ee-079d04cd77e6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:46.352678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1880153-ee2e-4476-b0ee-079d04cd77e6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:46.353141 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1880153-ee2e-4476-b0ee-079d04cd77e6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:46.354038 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1880153-ee2e-4476-b0ee-079d04cd77e6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:46.354531 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1880153-ee2e-4476-b0ee-079d04cd77e6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:46.400559 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d9535004-6daf-42a1-8d51-33afe607b8e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:46.401850 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d9535004-6daf-42a1-8d51-33afe607b8e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:46.412622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d9535004-6daf-42a1-8d51-33afe607b8e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:46.413089 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d9535004-6daf-42a1-8d51-33afe607b8e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:46.415471 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d9535004-6daf-42a1-8d51-33afe607b8e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:46.415927 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d9535004-6daf-42a1-8d51-33afe607b8e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:46.698280 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c1880153-ee2e-4476-b0ee-079d04cd77e6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:46.707507 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c1880153-ee2e-4476-b0ee-079d04cd77e6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 0.383279 Jul 21 17:34:46.721081 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 40/88] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:46 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:46.726012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-2a4ce02d-7960-4d44-a25a-4ff8a9615cd3 req-7037d0a9-4cd5-44df-918d-97a0c4db1e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff28a98-a8bf-43c7-ad64-2b693c0d419e", "name": "network-vif-plugged", "status": "completed", "tag": "79e6e077-66c3-4d54-9164-1c97dd9c881c"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:46.730098 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d9535004-6daf-42a1-8d51-33afe607b8e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:46.741676 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d9535004-6daf-42a1-8d51-33afe607b8e6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1367 microversion: 2.1 time: 0.345643 Jul 21 17:34:46.742347 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 49/89] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:46 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:46.745932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-2a4ce02d-7960-4d44-a25a-4ff8a9615cd3 req-7037d0a9-4cd5-44df-918d-97a0c4db1e6b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:46.746850 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-2a4ce02d-7960-4d44-a25a-4ff8a9615cd3 req-7037d0a9-4cd5-44df-918d-97a0c4db1e6b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:46.768607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-2a4ce02d-7960-4d44-a25a-4ff8a9615cd3 req-7037d0a9-4cd5-44df-918d-97a0c4db1e6b service nova] Creating event network-vif-plugged:79e6e077-66c3-4d54-9164-1c97dd9c881c for instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e on hv-cinder-82549 Jul 21 17:34:46.775277 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-2a4ce02d-7960-4d44-a25a-4ff8a9615cd3 req-7037d0a9-4cd5-44df-918d-97a0c4db1e6b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052722 Jul 21 17:34:46.776436 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 41/90] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:46.808545 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5d6c9857-29e4-4684-9572-85f107cb963e tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:46.810983 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5d6c9857-29e4-4684-9572-85f107cb963e tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:46.818181 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ebbfdb8d-ff19-426d-8933-1a1bf56ee951 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:46.818899 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ebbfdb8d-ff19-426d-8933-1a1bf56ee951 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:46.820561 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5d6c9857-29e4-4684-9572-85f107cb963e tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:46.821199 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5d6c9857-29e4-4684-9572-85f107cb963e tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:46.822376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5d6c9857-29e4-4684-9572-85f107cb963e tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:46.823903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5d6c9857-29e4-4684-9572-85f107cb963e tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:46.826959 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebbfdb8d-ff19-426d-8933-1a1bf56ee951 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:46.827420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebbfdb8d-ff19-426d-8933-1a1bf56ee951 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:46.828229 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebbfdb8d-ff19-426d-8933-1a1bf56ee951 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:46.828699 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebbfdb8d-ff19-426d-8933-1a1bf56ee951 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:47.007565 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:47.082033 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ebbfdb8d-ff19-426d-8933-1a1bf56ee951 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:47.090096 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ebbfdb8d-ff19-426d-8933-1a1bf56ee951 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.277400 Jul 21 17:34:47.091190 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 42/91] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:46 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:47.091707 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5d6c9857-29e4-4684-9572-85f107cb963e tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:47.100914 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5d6c9857-29e4-4684-9572-85f107cb963e tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1314 microversion: 2.1 time: 0.298897 Jul 21 17:34:47.101639 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 50/92] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:46 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:47.738389 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-61aa5dfe-33df-4537-bd5a-54fe355a1642 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:47.739013 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-61aa5dfe-33df-4537-bd5a-54fe355a1642 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:47.746765 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61aa5dfe-33df-4537-bd5a-54fe355a1642 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:47.747221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61aa5dfe-33df-4537-bd5a-54fe355a1642 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:47.748269 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61aa5dfe-33df-4537-bd5a-54fe355a1642 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:47.751100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61aa5dfe-33df-4537-bd5a-54fe355a1642 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:47.760360 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-22882f4d-f664-4492-ad37-f30459bb7322 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:47.761112 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-22882f4d-f664-4492-ad37-f30459bb7322 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:47.770143 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-22882f4d-f664-4492-ad37-f30459bb7322 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:47.770301 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-22882f4d-f664-4492-ad37-f30459bb7322 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:47.771081 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-22882f4d-f664-4492-ad37-f30459bb7322 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:47.771525 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-22882f4d-f664-4492-ad37-f30459bb7322 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:47.777094 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=100 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:48.031893 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-61aa5dfe-33df-4537-bd5a-54fe355a1642 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:48.040230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-61aa5dfe-33df-4537-bd5a-54fe355a1642 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 0.306347 Jul 21 17:34:48.050125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 43/93] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:48.068529 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-22882f4d-f664-4492-ad37-f30459bb7322 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:48.079318 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-22882f4d-f664-4492-ad37-f30459bb7322 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1557 microversion: 2.1 time: 0.323468 Jul 21 17:34:48.080120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 51/94] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:47 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1557 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:48.096653 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b3ddbe0b-b6fd-4093-8031-0343a7d4049a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:48.097272 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b3ddbe0b-b6fd-4093-8031-0343a7d4049a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:48.104017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b3ddbe0b-b6fd-4093-8031-0343a7d4049a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:48.104646 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b3ddbe0b-b6fd-4093-8031-0343a7d4049a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:48.105420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b3ddbe0b-b6fd-4093-8031-0343a7d4049a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:48.105856 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b3ddbe0b-b6fd-4093-8031-0343a7d4049a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:48.108426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2d4b81ec-2d20-40c2-b29a-e5a2dbece29d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:48.109074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2d4b81ec-2d20-40c2-b29a-e5a2dbece29d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:48.115464 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d4b81ec-2d20-40c2-b29a-e5a2dbece29d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:48.115996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d4b81ec-2d20-40c2-b29a-e5a2dbece29d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:48.117124 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d4b81ec-2d20-40c2-b29a-e5a2dbece29d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:48.117810 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d4b81ec-2d20-40c2-b29a-e5a2dbece29d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:48.299844 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b3ddbe0b-b6fd-4093-8031-0343a7d4049a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207003 Jul 21 17:34:48.300208 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 44/95] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 17:34:48 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:48.305213 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-78062496-2a9e-4f8c-96d6-d9bba3a4efa4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:48.305905 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-78062496-2a9e-4f8c-96d6-d9bba3a4efa4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:48.316558 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-78062496-2a9e-4f8c-96d6-d9bba3a4efa4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:48.317023 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-78062496-2a9e-4f8c-96d6-d9bba3a4efa4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:48.317932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-78062496-2a9e-4f8c-96d6-d9bba3a4efa4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:48.318235 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-78062496-2a9e-4f8c-96d6-d9bba3a4efa4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:48.348987 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2d4b81ec-2d20-40c2-b29a-e5a2dbece29d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:48.358337 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2d4b81ec-2d20-40c2-b29a-e5a2dbece29d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.255270 Jul 21 17:34:48.359348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 52/96] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:48 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:48.491160 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-78062496-2a9e-4f8c-96d6-d9bba3a4efa4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:48.500564 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-78062496-2a9e-4f8c-96d6-d9bba3a4efa4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1501 microversion: 2.1 time: 0.199257 Jul 21 17:34:48.512858 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 45/97] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:48 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1501 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:48.812108 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-c6ed2c22-58a6-4423-af4f-ba481cebcbcd req-491e9fd9-2557-4f24-b830-2b2673a493a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b7093e-b70d-4a59-bc9a-e08264c48761", "name": "network-vif-plugged", "status": "completed", "tag": "f6f5a2be-a21c-4d5e-8942-24180cec25a3"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:48.866291 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-c6ed2c22-58a6-4423-af4f-ba481cebcbcd req-491e9fd9-2557-4f24-b830-2b2673a493a1 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:48.867267 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-c6ed2c22-58a6-4423-af4f-ba481cebcbcd req-491e9fd9-2557-4f24-b830-2b2673a493a1 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:48.889662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-c6ed2c22-58a6-4423-af4f-ba481cebcbcd req-491e9fd9-2557-4f24-b830-2b2673a493a1 service nova] Creating event network-vif-plugged:f6f5a2be-a21c-4d5e-8942-24180cec25a3 for instance f2b7093e-b70d-4a59-bc9a-e08264c48761 on hv-cinder-82549 Jul 21 17:34:48.907524 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-c6ed2c22-58a6-4423-af4f-ba481cebcbcd req-491e9fd9-2557-4f24-b830-2b2673a493a1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102081 Jul 21 17:34:48.908339 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 53/98] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:49.066116 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4ccf4365-7bf5-4d01-9d7e-a617a0a7b24c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:49.066920 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4ccf4365-7bf5-4d01-9d7e-a617a0a7b24c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:49.085468 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ccf4365-7bf5-4d01-9d7e-a617a0a7b24c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:49.088438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ccf4365-7bf5-4d01-9d7e-a617a0a7b24c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:49.096319 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ccf4365-7bf5-4d01-9d7e-a617a0a7b24c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:49.097410 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ccf4365-7bf5-4d01-9d7e-a617a0a7b24c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:49.313545 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4ccf4365-7bf5-4d01-9d7e-a617a0a7b24c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:49.321415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4ccf4365-7bf5-4d01-9d7e-a617a0a7b24c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 0.267937 Jul 21 17:34:49.322107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 46/99] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:49 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:49.375926 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2f58f9ae-2e20-42b9-9cb1-01f5e3709752 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:49.376672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2f58f9ae-2e20-42b9-9cb1-01f5e3709752 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:49.383525 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2f58f9ae-2e20-42b9-9cb1-01f5e3709752 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:49.384308 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2f58f9ae-2e20-42b9-9cb1-01f5e3709752 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:49.386303 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2f58f9ae-2e20-42b9-9cb1-01f5e3709752 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:49.386759 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2f58f9ae-2e20-42b9-9cb1-01f5e3709752 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:49.581049 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2f58f9ae-2e20-42b9-9cb1-01f5e3709752 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:49.592211 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2f58f9ae-2e20-42b9-9cb1-01f5e3709752 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.220211 Jul 21 17:34:49.602137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 54/100] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:49 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:50.090623 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-52b51066-beb0-42e1-bb44-09d274e67ba8 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c600527-fc45-4329-bc94-20a4e9668802"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:50.091951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-52b51066-beb0-42e1-bb44-09d274e67ba8 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:50.098319 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-52b51066-beb0-42e1-bb44-09d274e67ba8 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:50.098982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-52b51066-beb0-42e1-bb44-09d274e67ba8 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:50.099828 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-52b51066-beb0-42e1-bb44-09d274e67ba8 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:50.100659 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-52b51066-beb0-42e1-bb44-09d274e67ba8 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:50.285284 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-ca0eb276-5239-407c-9398-d02a88b985fa req-84675e6d-56e4-49b2-bcbb-fe8aaa0173bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da2560b-0f95-4dac-9745-d34cecc16575", "tag": "83ce89a6-6dd2-4dd5-abf5-d6c811684318"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:50.297650 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-ca0eb276-5239-407c-9398-d02a88b985fa req-84675e6d-56e4-49b2-bcbb-fe8aaa0173bd service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:50.298513 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-ca0eb276-5239-407c-9398-d02a88b985fa req-84675e6d-56e4-49b2-bcbb-fe8aaa0173bd service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:50.335263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-ca0eb276-5239-407c-9398-d02a88b985fa req-84675e6d-56e4-49b2-bcbb-fe8aaa0173bd service nova] Creating event network-changed:83ce89a6-6dd2-4dd5-abf5-d6c811684318 for instance 2da2560b-0f95-4dac-9745-d34cecc16575 on hv-cinder-82549 Jul 21 17:34:50.341782 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-ca0eb276-5239-407c-9398-d02a88b985fa req-84675e6d-56e4-49b2-bcbb-fe8aaa0173bd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063568 Jul 21 17:34:50.342614 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 55/101] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:34:50.352447 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a61f3e4c-4bc4-4a1d-bd94-169ff520cb4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:50.353408 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a61f3e4c-4bc4-4a1d-bd94-169ff520cb4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:50.360560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a61f3e4c-4bc4-4a1d-bd94-169ff520cb4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:50.361241 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a61f3e4c-4bc4-4a1d-bd94-169ff520cb4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:50.362171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a61f3e4c-4bc4-4a1d-bd94-169ff520cb4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:50.362767 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a61f3e4c-4bc4-4a1d-bd94-169ff520cb4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:50.537536 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a61f3e4c-4bc4-4a1d-bd94-169ff520cb4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:50.549424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a61f3e4c-4bc4-4a1d-bd94-169ff520cb4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1364 microversion: 2.1 time: 0.205385 Jul 21 17:34:50.561894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 56/102] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:50 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:50.611857 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-040bbd02-a764-4a24-b754-2cbf4930c299 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:50.614416 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-040bbd02-a764-4a24-b754-2cbf4930c299 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:50.630221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-040bbd02-a764-4a24-b754-2cbf4930c299 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:50.630972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-040bbd02-a764-4a24-b754-2cbf4930c299 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:50.633766 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-040bbd02-a764-4a24-b754-2cbf4930c299 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:50.636646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-040bbd02-a764-4a24-b754-2cbf4930c299 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:50.845750 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-040bbd02-a764-4a24-b754-2cbf4930c299 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:50.856276 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-040bbd02-a764-4a24-b754-2cbf4930c299 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.250343 Jul 21 17:34:50.858417 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 57/103] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:50 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:50.933839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-c700488d-6a27-4d04-bb57-464135c5dea7 req-621cc0a8-1dcb-49ac-a941-96b2e435f63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "763d9b30-7ec8-42e4-9a88-2b7ff3a771cd", "name": "network-vif-plugged", "status": "completed", "tag": "34e81461-bec9-492f-a85f-2fc89ebdc164"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:50.946669 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-c700488d-6a27-4d04-bb57-464135c5dea7 req-621cc0a8-1dcb-49ac-a941-96b2e435f63a service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:50.948198 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-c700488d-6a27-4d04-bb57-464135c5dea7 req-621cc0a8-1dcb-49ac-a941-96b2e435f63a service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:50.969445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-c700488d-6a27-4d04-bb57-464135c5dea7 req-621cc0a8-1dcb-49ac-a941-96b2e435f63a service nova] Creating event network-vif-plugged:34e81461-bec9-492f-a85f-2fc89ebdc164 for instance 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd on hv-cinder-82549 Jul 21 17:34:50.975910 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-c700488d-6a27-4d04-bb57-464135c5dea7 req-621cc0a8-1dcb-49ac-a941-96b2e435f63a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047091 Jul 21 17:34:50.977244 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 58/104] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:34:51.568661 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-275a4d50-5c87-44dd-b282-c37dcb65a8ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:51.569563 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-275a4d50-5c87-44dd-b282-c37dcb65a8ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:51.583626 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-275a4d50-5c87-44dd-b282-c37dcb65a8ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:51.584099 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-275a4d50-5c87-44dd-b282-c37dcb65a8ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:51.585095 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-275a4d50-5c87-44dd-b282-c37dcb65a8ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:51.586615 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-275a4d50-5c87-44dd-b282-c37dcb65a8ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:52.138035 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-275a4d50-5c87-44dd-b282-c37dcb65a8ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:52.142270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-52b51066-beb0-42e1-bb44-09d274e67ba8 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "POST /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.056217 Jul 21 17:34:52.143424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 47/105] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 17:34:50 2022] POST /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75/os-volume_attachments => generated 194 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:52.152666 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-275a4d50-5c87-44dd-b282-c37dcb65a8ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1550 microversion: 2.1 time: 0.589044 Jul 21 17:34:52.153264 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 59/106] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1550 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:34:52.154049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-53b1051c-24da-4791-9591-b2aa6b12a258 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:52.155540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-53b1051c-24da-4791-9591-b2aa6b12a258 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:52.166908 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53b1051c-24da-4791-9591-b2aa6b12a258 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:52.167661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53b1051c-24da-4791-9591-b2aa6b12a258 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:52.168766 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53b1051c-24da-4791-9591-b2aa6b12a258 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:52.169374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53b1051c-24da-4791-9591-b2aa6b12a258 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:52.172758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-18ee043b-3fc7-489f-b167-430e13a5baa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:52.173263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-18ee043b-3fc7-489f-b167-430e13a5baa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:52.175180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:34:52.189447 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-18ee043b-3fc7-489f-b167-430e13a5baa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:52.191550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-18ee043b-3fc7-489f-b167-430e13a5baa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:52.209646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-18ee043b-3fc7-489f-b167-430e13a5baa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:52.210393 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-18ee043b-3fc7-489f-b167-430e13a5baa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:52.574690 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-18ee043b-3fc7-489f-b167-430e13a5baa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.405615 Jul 21 17:34:52.576430 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 60/107] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 17:34:52 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-interface => generated 284 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:34:52.711045 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-53b1051c-24da-4791-9591-b2aa6b12a258 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:52.723611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-53b1051c-24da-4791-9591-b2aa6b12a258 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.575608 Jul 21 17:34:52.725537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 48/108] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:52 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:53.741043 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f07288f3-db62-4138-bb85-eb13183ffd4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:53.741674 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f07288f3-db62-4138-bb85-eb13183ffd4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:53.752647 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f07288f3-db62-4138-bb85-eb13183ffd4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:53.755890 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f07288f3-db62-4138-bb85-eb13183ffd4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:53.764818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f07288f3-db62-4138-bb85-eb13183ffd4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:53.765344 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f07288f3-db62-4138-bb85-eb13183ffd4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:54.052143 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f07288f3-db62-4138-bb85-eb13183ffd4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:54.070321 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f07288f3-db62-4138-bb85-eb13183ffd4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1322 microversion: 2.1 time: 0.333359 Jul 21 17:34:54.070935 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 61/109] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:53 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:54.382234 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-3926e1be-ee0d-4d88-98b8-7e7f84c90a05 req-b0c9e80a-d7b9-4379-8ee4-bc5d8aa3668c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff28a98-a8bf-43c7-ad64-2b693c0d419e", "tag": "79e6e077-66c3-4d54-9164-1c97dd9c881c"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:54.391966 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3926e1be-ee0d-4d88-98b8-7e7f84c90a05 req-b0c9e80a-d7b9-4379-8ee4-bc5d8aa3668c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:54.392438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3926e1be-ee0d-4d88-98b8-7e7f84c90a05 req-b0c9e80a-d7b9-4379-8ee4-bc5d8aa3668c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:54.404633 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-3926e1be-ee0d-4d88-98b8-7e7f84c90a05 req-b0c9e80a-d7b9-4379-8ee4-bc5d8aa3668c service nova] Creating event network-changed:79e6e077-66c3-4d54-9164-1c97dd9c881c for instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e on hv-cinder-82549 Jul 21 17:34:54.409979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-3926e1be-ee0d-4d88-98b8-7e7f84c90a05 req-b0c9e80a-d7b9-4379-8ee4-bc5d8aa3668c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032274 Jul 21 17:34:54.411281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 49/110] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:34:55.087506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d8de88da-5a7f-4a4f-afe3-32e9bf129a66 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:55.091304 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d8de88da-5a7f-4a4f-afe3-32e9bf129a66 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:55.102209 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d8de88da-5a7f-4a4f-afe3-32e9bf129a66 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:55.104999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d8de88da-5a7f-4a4f-afe3-32e9bf129a66 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:55.112099 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d8de88da-5a7f-4a4f-afe3-32e9bf129a66 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:55.112532 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d8de88da-5a7f-4a4f-afe3-32e9bf129a66 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:55.608559 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d8de88da-5a7f-4a4f-afe3-32e9bf129a66 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:55.617864 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d8de88da-5a7f-4a4f-afe3-32e9bf129a66 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1517 microversion: 2.1 time: 0.534544 Jul 21 17:34:55.618454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 62/111] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:55 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1517 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:55.638585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bd58784d-bcc8-4876-8124-500ce7590f81 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:55.643920 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bd58784d-bcc8-4876-8124-500ce7590f81 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:55.651699 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bd58784d-bcc8-4876-8124-500ce7590f81 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:55.652164 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bd58784d-bcc8-4876-8124-500ce7590f81 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:55.652989 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bd58784d-bcc8-4876-8124-500ce7590f81 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:55.653429 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bd58784d-bcc8-4876-8124-500ce7590f81 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:55.682476 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-bd58784d-bcc8-4876-8124-500ce7590f81 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lazy-loading 'flavor' on Instance uuid 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 17:34:55.816835 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bd58784d-bcc8-4876-8124-500ce7590f81 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "POST /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd/action" status: 200 len: 32 microversion: 2.1 time: 0.184165 Jul 21 17:34:55.817591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 50/112] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 17:34:55 2022] POST /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 17:34:55.832664 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a00c51fb-6d17-4740-a112-fd6a7c0d7b2c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:55.834156 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a00c51fb-6d17-4740-a112-fd6a7c0d7b2c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:55.842499 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a00c51fb-6d17-4740-a112-fd6a7c0d7b2c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:55.842958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a00c51fb-6d17-4740-a112-fd6a7c0d7b2c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:55.843739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a00c51fb-6d17-4740-a112-fd6a7c0d7b2c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:55.844208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a00c51fb-6d17-4740-a112-fd6a7c0d7b2c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:56.051487 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-494907722", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "networks": [{"uuid": "6ffaf82a-6d6d-424d-bd1e-ff6283406a7d"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:34:56.093702 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a00c51fb-6d17-4740-a112-fd6a7c0d7b2c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:56.102358 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a00c51fb-6d17-4740-a112-fd6a7c0d7b2c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.277400 Jul 21 17:34:56.105489 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 63/113] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:55 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:56.117370 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] validate_networks() for [('6ffaf82a-6d6d-424d-bd1e-ff6283406a7d', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 17:34:56.648010 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 17:34:56.648619 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 17:34:56.649199 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 17:34:56.649772 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 17:34:56.650774 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 17:34:56.662105 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:56.673607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:56.674756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:56.675554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:56.698212 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Getting quotas for project e47e6891d6044e2caf067cad4309c57f. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:34:56.704096 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Getting quotas for user ac4cfa3ccdab43c3adafcef62e62365f and project e47e6891d6044e2caf067cad4309c57f. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:34:56.718834 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 17:34:56.722110 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 17:34:56.786523 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9d494bd7-f0d1-462c-b946-86d249ca995d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739199 Jul 21 17:34:56.788434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 51/114] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 17:34:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 17:34:56.797860 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ff729c1e-743f-46c8-80e8-da8127bf44cf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:56.800500 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ff729c1e-743f-46c8-80e8-da8127bf44cf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:56.865376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ff729c1e-743f-46c8-80e8-da8127bf44cf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:56.881770 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ff729c1e-743f-46c8-80e8-da8127bf44cf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1218 microversion: 2.1 time: 0.087918 Jul 21 17:34:56.882660 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 64/115] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:56 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:57.120878 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-59630438-538f-4a37-a4f6-3ab9f5f5d2f0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:57.121717 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-59630438-538f-4a37-a4f6-3ab9f5f5d2f0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:57.129200 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59630438-538f-4a37-a4f6-3ab9f5f5d2f0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:57.129992 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59630438-538f-4a37-a4f6-3ab9f5f5d2f0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:57.130831 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59630438-538f-4a37-a4f6-3ab9f5f5d2f0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:57.131338 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59630438-538f-4a37-a4f6-3ab9f5f5d2f0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:57.281816 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-59630438-538f-4a37-a4f6-3ab9f5f5d2f0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:57.289562 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-59630438-538f-4a37-a4f6-3ab9f5f5d2f0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.173226 Jul 21 17:34:57.290143 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 52/116] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:57 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:57.898938 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a0a9f955-6577-4219-979a-d8749445eb99 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:57.899555 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a0a9f955-6577-4219-979a-d8749445eb99 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:57.918471 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a0a9f955-6577-4219-979a-d8749445eb99 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:57.919254 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a0a9f955-6577-4219-979a-d8749445eb99 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:57.920487 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a0a9f955-6577-4219-979a-d8749445eb99 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:57.921129 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a0a9f955-6577-4219-979a-d8749445eb99 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:58.007675 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a0a9f955-6577-4219-979a-d8749445eb99 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:58.015602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a0a9f955-6577-4219-979a-d8749445eb99 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1270 microversion: 2.1 time: 0.120426 Jul 21 17:34:58.016286 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 65/117] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:57 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:58.307065 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e83f6327-a8b5-4955-937f-e968df615f9a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:58.307683 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e83f6327-a8b5-4955-937f-e968df615f9a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:58.314859 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e83f6327-a8b5-4955-937f-e968df615f9a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:58.315331 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e83f6327-a8b5-4955-937f-e968df615f9a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:58.316116 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e83f6327-a8b5-4955-937f-e968df615f9a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:58.316584 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e83f6327-a8b5-4955-937f-e968df615f9a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:58.454025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e83f6327-a8b5-4955-937f-e968df615f9a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:58.461792 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e83f6327-a8b5-4955-937f-e968df615f9a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.158692 Jul 21 17:34:58.462399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 53/118] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:58 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:59.034893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9955e3b0-ed59-41e7-bdb7-53150673a7fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:59.035516 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9955e3b0-ed59-41e7-bdb7-53150673a7fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:59.042573 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9955e3b0-ed59-41e7-bdb7-53150673a7fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:59.043354 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9955e3b0-ed59-41e7-bdb7-53150673a7fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:59.044371 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9955e3b0-ed59-41e7-bdb7-53150673a7fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:59.044989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9955e3b0-ed59-41e7-bdb7-53150673a7fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:59.292968 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9955e3b0-ed59-41e7-bdb7-53150673a7fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:59.305281 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9955e3b0-ed59-41e7-bdb7-53150673a7fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1318 microversion: 2.1 time: 0.274134 Jul 21 17:34:59.306254 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 66/119] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:59 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:34:59.480182 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-61f8711d-c3ef-4332-a8a6-2fe4515eac87 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:34:59.481129 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-61f8711d-c3ef-4332-a8a6-2fe4515eac87 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:34:59.488628 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61f8711d-c3ef-4332-a8a6-2fe4515eac87 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:59.489180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61f8711d-c3ef-4332-a8a6-2fe4515eac87 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:59.490085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61f8711d-c3ef-4332-a8a6-2fe4515eac87 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:34:59.490774 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61f8711d-c3ef-4332-a8a6-2fe4515eac87 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:34:59.719075 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-61f8711d-c3ef-4332-a8a6-2fe4515eac87 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:34:59.727582 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-61f8711d-c3ef-4332-a8a6-2fe4515eac87 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.252516 Jul 21 17:34:59.729158 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 54/120] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:34:59 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:00.293126 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-aebbaf21-01a0-42c2-9704-1da7300182d3 req-09bd18ed-649f-4c11-8f14-952e95a4c2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e14c1a66-269c-4e3f-95f6-6388fe5c16c1", "tag": "0e9ac75f-bb94-463e-bd6c-b7d141769a5c"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:35:00.306726 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-aebbaf21-01a0-42c2-9704-1da7300182d3 req-09bd18ed-649f-4c11-8f14-952e95a4c2b8 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:00.308328 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-aebbaf21-01a0-42c2-9704-1da7300182d3 req-09bd18ed-649f-4c11-8f14-952e95a4c2b8 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:00.330172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e3558294-1f66-4beb-ac6b-eb9b41834479 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:00.331218 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e3558294-1f66-4beb-ac6b-eb9b41834479 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:00.332701 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-aebbaf21-01a0-42c2-9704-1da7300182d3 req-09bd18ed-649f-4c11-8f14-952e95a4c2b8 service nova] Creating event network-changed:0e9ac75f-bb94-463e-bd6c-b7d141769a5c for instance e14c1a66-269c-4e3f-95f6-6388fe5c16c1 on hv-cinder-82549 Jul 21 17:35:00.339352 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e3558294-1f66-4beb-ac6b-eb9b41834479 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:00.340137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e3558294-1f66-4beb-ac6b-eb9b41834479 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:00.340662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-aebbaf21-01a0-42c2-9704-1da7300182d3 req-09bd18ed-649f-4c11-8f14-952e95a4c2b8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054389 Jul 21 17:35:00.341545 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 67/121] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:35:00.343174 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e3558294-1f66-4beb-ac6b-eb9b41834479 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:00.343911 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e3558294-1f66-4beb-ac6b-eb9b41834479 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:00.576722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e3558294-1f66-4beb-ac6b-eb9b41834479 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:00.595552 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e3558294-1f66-4beb-ac6b-eb9b41834479 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1318 microversion: 2.1 time: 0.273355 Jul 21 17:35:00.595552 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 55/122] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:00 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:35:00.748322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8bbe7c7a-9d7f-43fc-833f-cb7fa68a8891 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:00.748982 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8bbe7c7a-9d7f-43fc-833f-cb7fa68a8891 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:00.757772 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8bbe7c7a-9d7f-43fc-833f-cb7fa68a8891 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:00.758235 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8bbe7c7a-9d7f-43fc-833f-cb7fa68a8891 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:00.759238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8bbe7c7a-9d7f-43fc-833f-cb7fa68a8891 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:00.760008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8bbe7c7a-9d7f-43fc-833f-cb7fa68a8891 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:00.921792 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8bbe7c7a-9d7f-43fc-833f-cb7fa68a8891 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:00.938444 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8bbe7c7a-9d7f-43fc-833f-cb7fa68a8891 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.196596 Jul 21 17:35:00.940180 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 68/123] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:00 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:01.612584 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-57b9ed07-19b0-433e-8ab5-19951b7bf696 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:01.613203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-57b9ed07-19b0-433e-8ab5-19951b7bf696 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:01.620031 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-57b9ed07-19b0-433e-8ab5-19951b7bf696 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:01.620586 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-57b9ed07-19b0-433e-8ab5-19951b7bf696 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:01.621362 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-57b9ed07-19b0-433e-8ab5-19951b7bf696 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:01.621801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-57b9ed07-19b0-433e-8ab5-19951b7bf696 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:01.792428 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-57b9ed07-19b0-433e-8ab5-19951b7bf696 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:01.801273 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-57b9ed07-19b0-433e-8ab5-19951b7bf696 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1318 microversion: 2.1 time: 0.192450 Jul 21 17:35:01.801900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 56/124] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:01 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:01.958524 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5237e103-c92f-4d93-b35b-5a3e7a527092 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:01.963946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5237e103-c92f-4d93-b35b-5a3e7a527092 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:01.973959 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5237e103-c92f-4d93-b35b-5a3e7a527092 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:01.974408 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5237e103-c92f-4d93-b35b-5a3e7a527092 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:01.975184 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5237e103-c92f-4d93-b35b-5a3e7a527092 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:01.975631 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5237e103-c92f-4d93-b35b-5a3e7a527092 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:02.134945 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5237e103-c92f-4d93-b35b-5a3e7a527092 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:02.144510 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5237e103-c92f-4d93-b35b-5a3e7a527092 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.193236 Jul 21 17:35:02.155120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 69/125] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:01 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:02.820206 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b842b332-8c7f-4c65-bd9b-0662c1b9c48a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:02.821181 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b842b332-8c7f-4c65-bd9b-0662c1b9c48a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:02.829604 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b842b332-8c7f-4c65-bd9b-0662c1b9c48a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:02.830168 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b842b332-8c7f-4c65-bd9b-0662c1b9c48a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:02.831767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b842b332-8c7f-4c65-bd9b-0662c1b9c48a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:02.832044 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b842b332-8c7f-4c65-bd9b-0662c1b9c48a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:03.006947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b842b332-8c7f-4c65-bd9b-0662c1b9c48a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:03.024395 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b842b332-8c7f-4c65-bd9b-0662c1b9c48a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1318 microversion: 2.1 time: 0.209238 Jul 21 17:35:03.026053 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 57/126] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:02 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:03.161918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-620934bf-4328-437a-948a-43995863ebe6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:03.162535 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-620934bf-4328-437a-948a-43995863ebe6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:03.169317 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-620934bf-4328-437a-948a-43995863ebe6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:03.169774 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-620934bf-4328-437a-948a-43995863ebe6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:03.170601 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-620934bf-4328-437a-948a-43995863ebe6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:03.171045 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-620934bf-4328-437a-948a-43995863ebe6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:03.336995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-620934bf-4328-437a-948a-43995863ebe6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:03.348026 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-620934bf-4328-437a-948a-43995863ebe6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.189821 Jul 21 17:35:03.348942 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 70/127] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:03 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:03.401264 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-63a8f5c2-ba99-4182-98ce-783fa2fa776a tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:03.401943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-63a8f5c2-ba99-4182-98ce-783fa2fa776a tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:03.409049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63a8f5c2-ba99-4182-98ce-783fa2fa776a tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:03.409720 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63a8f5c2-ba99-4182-98ce-783fa2fa776a tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:03.410637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63a8f5c2-ba99-4182-98ce-783fa2fa776a tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:03.411083 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63a8f5c2-ba99-4182-98ce-783fa2fa776a tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:03.437978 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-63a8f5c2-ba99-4182-98ce-783fa2fa776a tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 17:35:03.533994 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-63a8f5c2-ba99-4182-98ce-783fa2fa776a tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 204 len: 0 microversion: 2.1 time: 0.138736 Jul 21 17:35:03.534738 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 58/128] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 17:35:03 2022] DELETE /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 17:35:03.543200 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c8973ea4-f2db-41a3-a902-b1f87d56042f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:03.543826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c8973ea4-f2db-41a3-a902-b1f87d56042f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:03.549806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c8973ea4-f2db-41a3-a902-b1f87d56042f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:03.550438 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c8973ea4-f2db-41a3-a902-b1f87d56042f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:03.551227 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c8973ea4-f2db-41a3-a902-b1f87d56042f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:03.551672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c8973ea4-f2db-41a3-a902-b1f87d56042f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:03.739254 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c8973ea4-f2db-41a3-a902-b1f87d56042f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:03.743676 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=100 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:35:03.751851 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c8973ea4-f2db-41a3-a902-b1f87d56042f tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1553 microversion: 2.1 time: 0.212605 Jul 21 17:35:03.753314 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 71/129] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:03 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1553 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:04.043597 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c45ead8f-2c1b-4d84-9d53-d260542fb1d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:04.044532 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c45ead8f-2c1b-4d84-9d53-d260542fb1d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:04.051232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c45ead8f-2c1b-4d84-9d53-d260542fb1d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:04.051686 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c45ead8f-2c1b-4d84-9d53-d260542fb1d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:04.052621 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c45ead8f-2c1b-4d84-9d53-d260542fb1d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:04.053063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c45ead8f-2c1b-4d84-9d53-d260542fb1d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:04.196438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c45ead8f-2c1b-4d84-9d53-d260542fb1d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:04.206088 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c45ead8f-2c1b-4d84-9d53-d260542fb1d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1318 microversion: 2.1 time: 0.167634 Jul 21 17:35:04.206872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 59/130] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:04 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:04.367022 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6443b383-02a8-4ed9-8fc5-1fef35e1a1f3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:04.367765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6443b383-02a8-4ed9-8fc5-1fef35e1a1f3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:04.374756 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6443b383-02a8-4ed9-8fc5-1fef35e1a1f3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:04.375286 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6443b383-02a8-4ed9-8fc5-1fef35e1a1f3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:04.376126 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6443b383-02a8-4ed9-8fc5-1fef35e1a1f3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:04.376658 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6443b383-02a8-4ed9-8fc5-1fef35e1a1f3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:04.553314 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6443b383-02a8-4ed9-8fc5-1fef35e1a1f3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:04.571386 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6443b383-02a8-4ed9-8fc5-1fef35e1a1f3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.208163 Jul 21 17:35:04.572599 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 72/131] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:04 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:04.777499 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e491f95e-5f70-4949-9052-2c3e713b62bc tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:04.778128 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e491f95e-5f70-4949-9052-2c3e713b62bc tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:04.784075 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e491f95e-5f70-4949-9052-2c3e713b62bc tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:04.784630 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e491f95e-5f70-4949-9052-2c3e713b62bc tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:04.785408 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e491f95e-5f70-4949-9052-2c3e713b62bc tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:04.785853 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e491f95e-5f70-4949-9052-2c3e713b62bc tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:04.918190 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e491f95e-5f70-4949-9052-2c3e713b62bc tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:04.926785 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e491f95e-5f70-4949-9052-2c3e713b62bc tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1553 microversion: 2.1 time: 0.153264 Jul 21 17:35:04.927755 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 60/132] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:04 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:05.223450 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-29d286f2-cdb4-44c1-971e-08e91c8eab04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:05.223989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-29d286f2-cdb4-44c1-971e-08e91c8eab04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:05.231427 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-29d286f2-cdb4-44c1-971e-08e91c8eab04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:05.231886 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-29d286f2-cdb4-44c1-971e-08e91c8eab04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:05.232706 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-29d286f2-cdb4-44c1-971e-08e91c8eab04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:05.233172 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-29d286f2-cdb4-44c1-971e-08e91c8eab04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:05.363119 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-29d286f2-cdb4-44c1-971e-08e91c8eab04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:05.370611 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-29d286f2-cdb4-44c1-971e-08e91c8eab04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1318 microversion: 2.1 time: 0.151135 Jul 21 17:35:05.371232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 73/133] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:05 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:05.589498 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-82a75533-8e15-4ade-9d4d-7e755a1d17b7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:05.590112 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-82a75533-8e15-4ade-9d4d-7e755a1d17b7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:05.596855 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82a75533-8e15-4ade-9d4d-7e755a1d17b7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:05.597316 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82a75533-8e15-4ade-9d4d-7e755a1d17b7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:05.598097 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82a75533-8e15-4ade-9d4d-7e755a1d17b7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:05.598540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82a75533-8e15-4ade-9d4d-7e755a1d17b7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:05.735279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-82a75533-8e15-4ade-9d4d-7e755a1d17b7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:05.743111 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-82a75533-8e15-4ade-9d4d-7e755a1d17b7 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.157997 Jul 21 17:35:05.743716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 61/134] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:05 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:05.945308 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-162cffa5-612a-478d-b74d-5b1f27d03f20 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:05.945935 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-162cffa5-612a-478d-b74d-5b1f27d03f20 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:05.954180 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-162cffa5-612a-478d-b74d-5b1f27d03f20 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:05.954707 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-162cffa5-612a-478d-b74d-5b1f27d03f20 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:05.955576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-162cffa5-612a-478d-b74d-5b1f27d03f20 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:05.956015 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-162cffa5-612a-478d-b74d-5b1f27d03f20 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:06.159558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-162cffa5-612a-478d-b74d-5b1f27d03f20 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:06.170375 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-162cffa5-612a-478d-b74d-5b1f27d03f20 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1553 microversion: 2.1 time: 0.228690 Jul 21 17:35:06.173168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 74/135] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:05 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:06.391844 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bab91418-ef87-468c-8a50-dead3555b8d9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:06.393637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bab91418-ef87-468c-8a50-dead3555b8d9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:06.402664 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:35:06.413714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bab91418-ef87-468c-8a50-dead3555b8d9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:06.422562 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bab91418-ef87-468c-8a50-dead3555b8d9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:06.424355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bab91418-ef87-468c-8a50-dead3555b8d9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:06.426984 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bab91418-ef87-468c-8a50-dead3555b8d9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:06.467868 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:35:06.687428 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:35:06.701344 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bab91418-ef87-468c-8a50-dead3555b8d9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:06.710752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bab91418-ef87-468c-8a50-dead3555b8d9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1318 microversion: 2.1 time: 0.326427 Jul 21 17:35:06.712072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 62/136] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:06 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:06.760873 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5e98f466-3469-4174-91dd-4e471575f7ee tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:06.762193 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5e98f466-3469-4174-91dd-4e471575f7ee tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:06.764181 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=83 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:35:06.769681 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5e98f466-3469-4174-91dd-4e471575f7ee tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:06.770128 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5e98f466-3469-4174-91dd-4e471575f7ee tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:06.770983 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5e98f466-3469-4174-91dd-4e471575f7ee tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:06.771440 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5e98f466-3469-4174-91dd-4e471575f7ee tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:06.879051 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:35:06.917347 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5e98f466-3469-4174-91dd-4e471575f7ee tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:06.927303 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5e98f466-3469-4174-91dd-4e471575f7ee tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.170536 Jul 21 17:35:06.936851 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 75/137] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:06 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:07.190426 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-af37d4dc-1c30-4718-9738-63293079bd76 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:07.191046 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-af37d4dc-1c30-4718-9738-63293079bd76 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:07.192945 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:35:07.199299 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-af37d4dc-1c30-4718-9738-63293079bd76 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:07.199763 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-af37d4dc-1c30-4718-9738-63293079bd76 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:07.200565 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-af37d4dc-1c30-4718-9738-63293079bd76 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:07.201026 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-af37d4dc-1c30-4718-9738-63293079bd76 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:07.333565 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-af37d4dc-1c30-4718-9738-63293079bd76 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:07.342566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-af37d4dc-1c30-4718-9738-63293079bd76 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1553 microversion: 2.1 time: 0.156018 Jul 21 17:35:07.343136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 63/138] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:07 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:07.733397 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-594b4151-3074-41ad-b2b2-dc4105be9022 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:07.733707 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-594b4151-3074-41ad-b2b2-dc4105be9022 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:07.740275 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-594b4151-3074-41ad-b2b2-dc4105be9022 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:07.740827 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-594b4151-3074-41ad-b2b2-dc4105be9022 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:07.741731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-594b4151-3074-41ad-b2b2-dc4105be9022 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:07.742244 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-594b4151-3074-41ad-b2b2-dc4105be9022 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:07.944641 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9598bf8d-fabe-473e-95ea-bd323b02b0a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:07.945415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9598bf8d-fabe-473e-95ea-bd323b02b0a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:07.958111 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9598bf8d-fabe-473e-95ea-bd323b02b0a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:07.959375 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9598bf8d-fabe-473e-95ea-bd323b02b0a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:07.959869 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9598bf8d-fabe-473e-95ea-bd323b02b0a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:07.960354 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9598bf8d-fabe-473e-95ea-bd323b02b0a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:08.273778 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-594b4151-3074-41ad-b2b2-dc4105be9022 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:08.287367 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-594b4151-3074-41ad-b2b2-dc4105be9022 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1318 microversion: 2.1 time: 0.557184 Jul 21 17:35:08.288627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 76/139] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:07 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:08.302081 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9598bf8d-fabe-473e-95ea-bd323b02b0a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:08.312078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-c080eb59-9682-4b06-a9ac-8aa61f005ba1 req-7706dffd-e888-42f5-9bb5-34182f45033c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d609ed27-a097-4130-a95c-8bda2c656a75", "name": "network-vif-deleted", "tag": "3bfbe1d0-f339-4c79-b3ee-0c2ee6d55cca"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:35:08.314776 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9598bf8d-fabe-473e-95ea-bd323b02b0a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.374035 Jul 21 17:35:08.316028 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 64/140] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:07 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:08.325564 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-c080eb59-9682-4b06-a9ac-8aa61f005ba1 req-7706dffd-e888-42f5-9bb5-34182f45033c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:08.326452 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-c080eb59-9682-4b06-a9ac-8aa61f005ba1 req-7706dffd-e888-42f5-9bb5-34182f45033c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:08.346457 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-c080eb59-9682-4b06-a9ac-8aa61f005ba1 req-7706dffd-e888-42f5-9bb5-34182f45033c service nova] Creating event network-vif-deleted:3bfbe1d0-f339-4c79-b3ee-0c2ee6d55cca for instance d609ed27-a097-4130-a95c-8bda2c656a75 on hv-cinder-82549 Jul 21 17:35:08.353389 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-c080eb59-9682-4b06-a9ac-8aa61f005ba1 req-7706dffd-e888-42f5-9bb5-34182f45033c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062153 Jul 21 17:35:08.354761 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 77/141] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:35:08.365013 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3760a2dc-e691-43ff-a369-5946c2df3bd4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:08.365874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3760a2dc-e691-43ff-a369-5946c2df3bd4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:08.377382 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3760a2dc-e691-43ff-a369-5946c2df3bd4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:08.377868 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3760a2dc-e691-43ff-a369-5946c2df3bd4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:08.378950 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3760a2dc-e691-43ff-a369-5946c2df3bd4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:08.380267 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3760a2dc-e691-43ff-a369-5946c2df3bd4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:08.448807 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3760a2dc-e691-43ff-a369-5946c2df3bd4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5e836103d274f9386f2dd933acd982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52012c88f1e4cc59092d37fcc0fa23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:08.457501 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3760a2dc-e691-43ff-a369-5946c2df3bd4 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 200 len: 1345 microversion: 2.1 time: 0.101466 Jul 21 17:35:08.458230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 65/142] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:08 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 1345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:09.306174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8c3d1c82-60e9-41b3-91b9-7d6f350c423c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:09.306901 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8c3d1c82-60e9-41b3-91b9-7d6f350c423c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:09.313698 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8c3d1c82-60e9-41b3-91b9-7d6f350c423c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:09.314141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8c3d1c82-60e9-41b3-91b9-7d6f350c423c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:09.314912 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8c3d1c82-60e9-41b3-91b9-7d6f350c423c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:09.315342 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8c3d1c82-60e9-41b3-91b9-7d6f350c423c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:09.333775 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b5cb845b-ecae-43d2-9e2e-d39a3a022fb8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:09.334396 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b5cb845b-ecae-43d2-9e2e-d39a3a022fb8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:09.341142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5cb845b-ecae-43d2-9e2e-d39a3a022fb8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:09.341597 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5cb845b-ecae-43d2-9e2e-d39a3a022fb8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:09.342399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5cb845b-ecae-43d2-9e2e-d39a3a022fb8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:09.342943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5cb845b-ecae-43d2-9e2e-d39a3a022fb8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:09.585462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8c3d1c82-60e9-41b3-91b9-7d6f350c423c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:09.595522 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b5cb845b-ecae-43d2-9e2e-d39a3a022fb8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:09.596779 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8c3d1c82-60e9-41b3-91b9-7d6f350c423c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1318 microversion: 2.1 time: 0.294924 Jul 21 17:35:09.598920 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 78/143] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:09 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:09.606557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b5cb845b-ecae-43d2-9e2e-d39a3a022fb8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.276848 Jul 21 17:35:09.607609 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 66/144] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:09 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:35:09.611100 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-19e0640c-6856-4056-b750-fa6e8482a9e7 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:09.611859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-19e0640c-6856-4056-b750-fa6e8482a9e7 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:09.618178 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-19e0640c-6856-4056-b750-fa6e8482a9e7 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:09.619100 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-19e0640c-6856-4056-b750-fa6e8482a9e7 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:09.620056 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-19e0640c-6856-4056-b750-fa6e8482a9e7 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:09.620555 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-19e0640c-6856-4056-b750-fa6e8482a9e7 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:09.638003 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-19e0640c-6856-4056-b750-fa6e8482a9e7 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] HTTP exception thrown: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-19e0640c-6856-4056-b750-fa6e8482a9e7 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Request method failure captured: Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 HTTP/1.1 Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Y4UxuVn6-GC8C_ZRsR2cRvw2iCxnnZZqE_GCIqAuxwx6evfJWD7nOQSFlnnCpjCTCk647k2e3bijtb4nH2_XHQUFuNNqRUBMnJk459SV22VkhGGxFeXp60eBA5ENqMLjNqJWG_L5NQ06nkvrHguN-HY_UTeRLbc6QGRl3Cb6AiFgFI Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: f52012c88f1e4cc59092d37fcc0fa23a Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-DeleteServersTestJSON-764537326 Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 17:35:09.643392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 17:35:09.644897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f52012c88f1e4cc59092d37fcc0fa23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f52012c88f1e4cc59092d37fcc0fa23a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f52012c88f1e4cc59092d37fcc0fa23a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f52012c88f1e4cc59092d37fcc0fa23a"}]}] Jul 21 17:35:09.644897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-DeleteServersTestJSON-764537326 Jul 21 17:35:09.644897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: f52012c88f1e4cc59092d37fcc0fa23a Jul 21 17:35:09.644897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-DeleteServersTestJSON-764537326 Jul 21 17:35:09.644897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-DeleteServersTestJSON-764537326-project Jul 21 17:35:09.644897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 17:35:09.644897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 17:35:09.644897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: c5e836103d274f9386f2dd933acd982d Jul 21 17:35:09.644897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-DeleteServersTestJSON-764537326-project Jul 21 17:35:09.644897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 17:35:09.644897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:09.644897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': 'd609ed27-a097-4130-a95c-8bda2c656a75'} Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:35:09.645754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:09.647062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:35:09.648233 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-19e0640c-6856-4056-b750-fa6e8482a9e7 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Returning 404 to user: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:35:09.648558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-19e0640c-6856-4056-b750-fa6e8482a9e7 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 404 len: 111 microversion: 2.1 time: 0.048045 Jul 21 17:35:09.649303 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 79/145] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:09 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 17:35:09.827993 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e859b040-4baf-4389-9fc5-df8aa7919b78 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:09.829550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e859b040-4baf-4389-9fc5-df8aa7919b78 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:09.843253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e859b040-4baf-4389-9fc5-df8aa7919b78 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:09.844115 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e859b040-4baf-4389-9fc5-df8aa7919b78 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:09.845327 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e859b040-4baf-4389-9fc5-df8aa7919b78 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:09.846535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e859b040-4baf-4389-9fc5-df8aa7919b78 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:09.865279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-e859b040-4baf-4389-9fc5-df8aa7919b78 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] HTTP exception thrown: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e859b040-4baf-4389-9fc5-df8aa7919b78 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Request method failure captured: Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75/os-volume_attachments HTTP/1.1 Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y4UxuVn6-GC8C_ZRsR2cRvw2iCxnnZZqE_GCIqAuxwx6evfJWD7nOQSFlnnCpjCTCk647k2e3bijtb4nH2_XHQUFuNNqRUBMnJk459SV22VkhGGxFeXp60eBA5ENqMLjNqJWG_L5NQ06nkvrHguN-HY_UTeRLbc6QGRl3Cb6AiFgFI Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: f52012c88f1e4cc59092d37fcc0fa23a Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-DeleteServersTestJSON-764537326 Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 17:35:09.870951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 17:35:09.872445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f52012c88f1e4cc59092d37fcc0fa23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f52012c88f1e4cc59092d37fcc0fa23a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f52012c88f1e4cc59092d37fcc0fa23a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f52012c88f1e4cc59092d37fcc0fa23a"}]}] Jul 21 17:35:09.872445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-DeleteServersTestJSON-764537326 Jul 21 17:35:09.872445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: f52012c88f1e4cc59092d37fcc0fa23a Jul 21 17:35:09.872445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-DeleteServersTestJSON-764537326 Jul 21 17:35:09.872445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-DeleteServersTestJSON-764537326-project Jul 21 17:35:09.872445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 17:35:09.872445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 17:35:09.872445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: c5e836103d274f9386f2dd933acd982d Jul 21 17:35:09.872445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-DeleteServersTestJSON-764537326-project Jul 21 17:35:09.872445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 17:35:09.872445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:09.872445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'server_id': 'd609ed27-a097-4130-a95c-8bda2c656a75'} Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:35:09.873232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:09.874561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:35:09.876983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e859b040-4baf-4389-9fc5-df8aa7919b78 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Returning 404 to user: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:35:09.878692 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e859b040-4baf-4389-9fc5-df8aa7919b78 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.057558 Jul 21 17:35:09.880365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 67/146] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:35:09 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75/os-volume_attachments => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 17:35:10.061166 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-4a18716d-4c3f-4544-8494-627cecf7a4e6 req-9bc71e13-84cd-408a-98bd-cc3844cdeb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14c1a66-269c-4e3f-95f6-6388fe5c16c1", "name": "network-vif-plugged", "status": "completed", "tag": "0e9ac75f-bb94-463e-bd6c-b7d141769a5c"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:35:10.080103 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-4a18716d-4c3f-4544-8494-627cecf7a4e6 req-9bc71e13-84cd-408a-98bd-cc3844cdeb3d service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:10.083639 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-4a18716d-4c3f-4544-8494-627cecf7a4e6 req-9bc71e13-84cd-408a-98bd-cc3844cdeb3d service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:10.096243 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-4a18716d-4c3f-4544-8494-627cecf7a4e6 req-9bc71e13-84cd-408a-98bd-cc3844cdeb3d service nova] Creating event network-vif-plugged:0e9ac75f-bb94-463e-bd6c-b7d141769a5c for instance e14c1a66-269c-4e3f-95f6-6388fe5c16c1 on hv-cinder-82549 Jul 21 17:35:10.108268 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-4a18716d-4c3f-4544-8494-627cecf7a4e6 req-9bc71e13-84cd-408a-98bd-cc3844cdeb3d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049257 Jul 21 17:35:10.109646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 80/147] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:35:10.615891 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f41cf11f-b668-4a2b-a4c5-2ecb38247b00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:10.616533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f41cf11f-b668-4a2b-a4c5-2ecb38247b00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:10.623287 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f41cf11f-b668-4a2b-a4c5-2ecb38247b00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:10.623731 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f41cf11f-b668-4a2b-a4c5-2ecb38247b00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:10.624524 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f41cf11f-b668-4a2b-a4c5-2ecb38247b00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:10.624830 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dcfe1233-706a-416a-b32a-ca3369dd35c2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:10.625241 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f41cf11f-b668-4a2b-a4c5-2ecb38247b00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:10.625521 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dcfe1233-706a-416a-b32a-ca3369dd35c2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:10.631696 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dcfe1233-706a-416a-b32a-ca3369dd35c2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:10.632144 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dcfe1233-706a-416a-b32a-ca3369dd35c2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:10.632947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dcfe1233-706a-416a-b32a-ca3369dd35c2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:10.633383 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dcfe1233-706a-416a-b32a-ca3369dd35c2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:10.825989 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f41cf11f-b668-4a2b-a4c5-2ecb38247b00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:10.830188 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-dcfe1233-706a-416a-b32a-ca3369dd35c2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:10.833819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f41cf11f-b668-4a2b-a4c5-2ecb38247b00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1318 microversion: 2.1 time: 0.222251 Jul 21 17:35:10.834423 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 68/148] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:10 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:10.838116 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dcfe1233-706a-416a-b32a-ca3369dd35c2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.218630 Jul 21 17:35:10.838914 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 81/149] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:10 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:35:11.226727 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ee9b134f-5c0a-46ec-95aa-e857b5e38a83 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:11.227180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ee9b134f-5c0a-46ec-95aa-e857b5e38a83 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:11.234837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ee9b134f-5c0a-46ec-95aa-e857b5e38a83 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:11.235487 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ee9b134f-5c0a-46ec-95aa-e857b5e38a83 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:11.236282 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ee9b134f-5c0a-46ec-95aa-e857b5e38a83 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:11.236748 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ee9b134f-5c0a-46ec-95aa-e857b5e38a83 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:11.251568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-ee9b134f-5c0a-46ec-95aa-e857b5e38a83 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] HTTP exception thrown: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ee9b134f-5c0a-46ec-95aa-e857b5e38a83 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Request method failure captured: Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 HTTP/1.1 Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y4UxuVn6-GC8C_ZRsR2cRvw2iCxnnZZqE_GCIqAuxwx6evfJWD7nOQSFlnnCpjCTCk647k2e3bijtb4nH2_XHQUFuNNqRUBMnJk459SV22VkhGGxFeXp60eBA5ENqMLjNqJWG_L5NQ06nkvrHguN-HY_UTeRLbc6QGRl3Cb6AiFgFI Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: f52012c88f1e4cc59092d37fcc0fa23a Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-DeleteServersTestJSON-764537326 Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 17:35:11.253798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 17:35:11.255320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f52012c88f1e4cc59092d37fcc0fa23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f52012c88f1e4cc59092d37fcc0fa23a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f52012c88f1e4cc59092d37fcc0fa23a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f52012c88f1e4cc59092d37fcc0fa23a"}]}] Jul 21 17:35:11.255320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-DeleteServersTestJSON-764537326 Jul 21 17:35:11.255320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: f52012c88f1e4cc59092d37fcc0fa23a Jul 21 17:35:11.255320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-DeleteServersTestJSON-764537326 Jul 21 17:35:11.255320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-DeleteServersTestJSON-764537326-project Jul 21 17:35:11.255320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 17:35:11.255320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 17:35:11.255320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: c5e836103d274f9386f2dd933acd982d Jul 21 17:35:11.255320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-DeleteServersTestJSON-764537326-project Jul 21 17:35:11.255320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 17:35:11.255320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:11.255320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': 'd609ed27-a097-4130-a95c-8bda2c656a75'} Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:35:11.256107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:11.257193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:35:11.258270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ee9b134f-5c0a-46ec-95aa-e857b5e38a83 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Returning 404 to user: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:35:11.258270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ee9b134f-5c0a-46ec-95aa-e857b5e38a83 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 404 len: 111 microversion: 2.1 time: 0.032562 Jul 21 17:35:11.258270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 69/150] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 17:35:11 2022] DELETE /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 17:35:11.264706 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e2e3dc34-9c7d-489b-87bd-f7860df3ad84 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:11.265672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e2e3dc34-9c7d-489b-87bd-f7860df3ad84 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] [instance: d609ed27-a097-4130-a95c-8bda2c656a75] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:11.272219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2e3dc34-9c7d-489b-87bd-f7860df3ad84 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:11.272709 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2e3dc34-9c7d-489b-87bd-f7860df3ad84 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:11.273486 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2e3dc34-9c7d-489b-87bd-f7860df3ad84 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:11.273943 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2e3dc34-9c7d-489b-87bd-f7860df3ad84 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:11.288265 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-e2e3dc34-9c7d-489b-87bd-f7860df3ad84 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] HTTP exception thrown: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e2e3dc34-9c7d-489b-87bd-f7860df3ad84 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Request method failure captured: Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 HTTP/1.1 Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Y4UxuVn6-GC8C_ZRsR2cRvw2iCxnnZZqE_GCIqAuxwx6evfJWD7nOQSFlnnCpjCTCk647k2e3bijtb4nH2_XHQUFuNNqRUBMnJk459SV22VkhGGxFeXp60eBA5ENqMLjNqJWG_L5NQ06nkvrHguN-HY_UTeRLbc6QGRl3Cb6AiFgFI Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: f52012c88f1e4cc59092d37fcc0fa23a Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-DeleteServersTestJSON-764537326 Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 17:35:11.289952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 17:35:11.292395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f52012c88f1e4cc59092d37fcc0fa23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f52012c88f1e4cc59092d37fcc0fa23a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f52012c88f1e4cc59092d37fcc0fa23a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f52012c88f1e4cc59092d37fcc0fa23a"}]}] Jul 21 17:35:11.292395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-DeleteServersTestJSON-764537326 Jul 21 17:35:11.292395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: f52012c88f1e4cc59092d37fcc0fa23a Jul 21 17:35:11.292395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-DeleteServersTestJSON-764537326 Jul 21 17:35:11.292395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-DeleteServersTestJSON-764537326-project Jul 21 17:35:11.292395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 17:35:11.292395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 17:35:11.292395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: c5e836103d274f9386f2dd933acd982d Jul 21 17:35:11.292395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-DeleteServersTestJSON-764537326-project Jul 21 17:35:11.292395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 17:35:11.292395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:11.292395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': 'd609ed27-a097-4130-a95c-8bda2c656a75'} Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:35:11.293215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. Jul 21 17:35:11.294228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:35:11.295184 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e2e3dc34-9c7d-489b-87bd-f7860df3ad84 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] Returning 404 to user: Instance d609ed27-a097-4130-a95c-8bda2c656a75 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:35:11.295184 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e2e3dc34-9c7d-489b-87bd-f7860df3ad84 tempest-DeleteServersTestJSON-764537326 tempest-DeleteServersTestJSON-764537326-project] 10.222.0.57 "GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75" status: 404 len: 111 microversion: 2.1 time: 0.030685 Jul 21 17:35:11.295184 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 82/151] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:11 2022] GET /compute/v2.1/servers/d609ed27-a097-4130-a95c-8bda2c656a75 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 17:35:11.853284 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3bf67bae-88da-4139-8edf-725bbc3f2baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:11.855101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3bf67bae-88da-4139-8edf-725bbc3f2baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:11.855440 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-eb2738e5-d051-4148-8ab2-ff303cd9e748 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:11.856046 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-eb2738e5-d051-4148-8ab2-ff303cd9e748 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:11.864107 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-eb2738e5-d051-4148-8ab2-ff303cd9e748 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:11.864593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-eb2738e5-d051-4148-8ab2-ff303cd9e748 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:11.865515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-eb2738e5-d051-4148-8ab2-ff303cd9e748 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:11.866283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-eb2738e5-d051-4148-8ab2-ff303cd9e748 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:11.870975 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bf67bae-88da-4139-8edf-725bbc3f2baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:11.871731 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bf67bae-88da-4139-8edf-725bbc3f2baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:11.874028 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bf67bae-88da-4139-8edf-725bbc3f2baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:11.874768 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bf67bae-88da-4139-8edf-725bbc3f2baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:12.205943 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-eb2738e5-d051-4148-8ab2-ff303cd9e748 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:12.210313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3bf67bae-88da-4139-8edf-725bbc3f2baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:12.218593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-eb2738e5-d051-4148-8ab2-ff303cd9e748 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.367373 Jul 21 17:35:12.219374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3bf67bae-88da-4139-8edf-725bbc3f2baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1507 microversion: 2.1 time: 0.371663 Jul 21 17:35:12.219640 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 83/152] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:11 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:35:12.230521 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 70/153] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:11 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:13.235472 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-12052b0e-d355-466a-acac-57863e4b4f1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:13.236059 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-12052b0e-d355-466a-acac-57863e4b4f1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:13.242239 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12052b0e-d355-466a-acac-57863e4b4f1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:13.242696 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12052b0e-d355-466a-acac-57863e4b4f1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:13.243477 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12052b0e-d355-466a-acac-57863e4b4f1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:13.243919 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12052b0e-d355-466a-acac-57863e4b4f1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:13.390745 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-12052b0e-d355-466a-acac-57863e4b4f1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:13.399683 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-12052b0e-d355-466a-acac-57863e4b4f1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.167972 Jul 21 17:35:13.401519 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 84/154] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:13 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:14.418401 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bf941fce-76c8-4817-b2c1-4f2e351f752b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:14.419074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bf941fce-76c8-4817-b2c1-4f2e351f752b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:14.428093 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf941fce-76c8-4817-b2c1-4f2e351f752b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:14.428093 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf941fce-76c8-4817-b2c1-4f2e351f752b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:14.434985 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf941fce-76c8-4817-b2c1-4f2e351f752b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:14.435975 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf941fce-76c8-4817-b2c1-4f2e351f752b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:14.852816 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bf941fce-76c8-4817-b2c1-4f2e351f752b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:14.865569 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bf941fce-76c8-4817-b2c1-4f2e351f752b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.450527 Jul 21 17:35:14.877746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 71/155] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:14 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:15.882834 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-21b619ca-6c05-4658-becb-cfacad8d97e0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:15.883680 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-21b619ca-6c05-4658-becb-cfacad8d97e0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:15.891619 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-21b619ca-6c05-4658-becb-cfacad8d97e0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:15.892167 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-21b619ca-6c05-4658-becb-cfacad8d97e0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:15.893075 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-21b619ca-6c05-4658-becb-cfacad8d97e0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:15.893571 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-21b619ca-6c05-4658-becb-cfacad8d97e0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:16.062851 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-21b619ca-6c05-4658-becb-cfacad8d97e0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:16.070558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-21b619ca-6c05-4658-becb-cfacad8d97e0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.191564 Jul 21 17:35:16.071144 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 85/156] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:15 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:17.086874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bcea8fb5-532d-4937-96b3-e266c2bcc4a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:17.087538 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bcea8fb5-532d-4937-96b3-e266c2bcc4a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:17.094777 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bcea8fb5-532d-4937-96b3-e266c2bcc4a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:17.095242 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bcea8fb5-532d-4937-96b3-e266c2bcc4a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:17.096024 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bcea8fb5-532d-4937-96b3-e266c2bcc4a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:17.096506 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bcea8fb5-532d-4937-96b3-e266c2bcc4a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:17.237634 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bcea8fb5-532d-4937-96b3-e266c2bcc4a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:17.246448 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bcea8fb5-532d-4937-96b3-e266c2bcc4a6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.163162 Jul 21 17:35:17.247134 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 72/157] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:17 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:18.263017 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-395d5bae-af6c-445b-85d4-52341a24fcc3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:18.263536 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-395d5bae-af6c-445b-85d4-52341a24fcc3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:18.269645 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-395d5bae-af6c-445b-85d4-52341a24fcc3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:18.270097 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-395d5bae-af6c-445b-85d4-52341a24fcc3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:18.270859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-395d5bae-af6c-445b-85d4-52341a24fcc3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:18.271293 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-395d5bae-af6c-445b-85d4-52341a24fcc3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:18.401850 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-395d5bae-af6c-445b-85d4-52341a24fcc3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:18.409257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-395d5bae-af6c-445b-85d4-52341a24fcc3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.150274 Jul 21 17:35:18.409819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 86/158] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:18 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:19.425950 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-641e9276-cd85-4623-855d-e0e328e6a101 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:19.426608 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-641e9276-cd85-4623-855d-e0e328e6a101 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:19.434362 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-641e9276-cd85-4623-855d-e0e328e6a101 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:19.434819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-641e9276-cd85-4623-855d-e0e328e6a101 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:19.435586 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-641e9276-cd85-4623-855d-e0e328e6a101 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:19.436025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-641e9276-cd85-4623-855d-e0e328e6a101 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:19.571655 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-641e9276-cd85-4623-855d-e0e328e6a101 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:19.579572 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-641e9276-cd85-4623-855d-e0e328e6a101 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.157488 Jul 21 17:35:19.580141 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 73/159] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:19 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:20.596852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c54aff0f-5255-4bd7-b45e-2a32c902ac6b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:20.597461 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c54aff0f-5255-4bd7-b45e-2a32c902ac6b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:20.604608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c54aff0f-5255-4bd7-b45e-2a32c902ac6b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:20.605109 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c54aff0f-5255-4bd7-b45e-2a32c902ac6b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:20.605907 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c54aff0f-5255-4bd7-b45e-2a32c902ac6b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:20.606518 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c54aff0f-5255-4bd7-b45e-2a32c902ac6b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:20.749739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c54aff0f-5255-4bd7-b45e-2a32c902ac6b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:20.757233 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c54aff0f-5255-4bd7-b45e-2a32c902ac6b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.164259 Jul 21 17:35:20.757792 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 87/160] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:20 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:21.774641 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-82c3de51-faaf-479d-a126-212b00276d8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:21.775982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-82c3de51-faaf-479d-a126-212b00276d8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:21.782466 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82c3de51-faaf-479d-a126-212b00276d8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:21.782913 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82c3de51-faaf-479d-a126-212b00276d8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:21.783681 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82c3de51-faaf-479d-a126-212b00276d8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:21.784119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82c3de51-faaf-479d-a126-212b00276d8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:21.913967 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-82c3de51-faaf-479d-a126-212b00276d8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:21.922514 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-82c3de51-faaf-479d-a126-212b00276d8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.151800 Jul 21 17:35:21.923090 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 74/161] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:21 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:22.939362 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c8144bdf-e3cb-486c-b1c4-175fa29907b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:22.939978 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c8144bdf-e3cb-486c-b1c4-175fa29907b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:22.946130 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c8144bdf-e3cb-486c-b1c4-175fa29907b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:22.946584 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c8144bdf-e3cb-486c-b1c4-175fa29907b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:22.947911 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c8144bdf-e3cb-486c-b1c4-175fa29907b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:22.948536 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c8144bdf-e3cb-486c-b1c4-175fa29907b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:23.082280 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c8144bdf-e3cb-486c-b1c4-175fa29907b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:23.089719 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c8144bdf-e3cb-486c-b1c4-175fa29907b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.154244 Jul 21 17:35:23.090287 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 88/162] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:22 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:24.106919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-87549530-a29b-410f-b882-6c23d1e73466 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:24.107598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-87549530-a29b-410f-b882-6c23d1e73466 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:24.115320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87549530-a29b-410f-b882-6c23d1e73466 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:24.115796 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87549530-a29b-410f-b882-6c23d1e73466 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:24.116594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87549530-a29b-410f-b882-6c23d1e73466 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:24.117125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87549530-a29b-410f-b882-6c23d1e73466 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:24.270937 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-87549530-a29b-410f-b882-6c23d1e73466 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:24.279227 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-87549530-a29b-410f-b882-6c23d1e73466 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.176323 Jul 21 17:35:24.280075 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 75/163] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:24 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:25.296415 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a7ae840d-ebeb-413a-90b4-1b313365f583 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:25.297026 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a7ae840d-ebeb-413a-90b4-1b313365f583 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:25.303111 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a7ae840d-ebeb-413a-90b4-1b313365f583 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:25.303557 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a7ae840d-ebeb-413a-90b4-1b313365f583 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:25.304325 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a7ae840d-ebeb-413a-90b4-1b313365f583 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:25.304764 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a7ae840d-ebeb-413a-90b4-1b313365f583 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:25.436322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a7ae840d-ebeb-413a-90b4-1b313365f583 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:25.443924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a7ae840d-ebeb-413a-90b4-1b313365f583 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.151365 Jul 21 17:35:25.444516 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 89/164] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:25 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:35:26.467119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-871f1adf-459d-4adf-8c5b-f646adae67ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:26.468333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-871f1adf-459d-4adf-8c5b-f646adae67ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:26.474836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-871f1adf-459d-4adf-8c5b-f646adae67ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:26.475535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-871f1adf-459d-4adf-8c5b-f646adae67ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:26.476676 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-871f1adf-459d-4adf-8c5b-f646adae67ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:26.477297 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-871f1adf-459d-4adf-8c5b-f646adae67ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:26.624892 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-871f1adf-459d-4adf-8c5b-f646adae67ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:26.632672 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-871f1adf-459d-4adf-8c5b-f646adae67ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.175840 Jul 21 17:35:26.642822 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 76/165] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:26 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:27.650533 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a8b18350-86b4-48f4-8a72-86516f7c50e8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:27.651195 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a8b18350-86b4-48f4-8a72-86516f7c50e8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:27.657581 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a8b18350-86b4-48f4-8a72-86516f7c50e8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:27.658028 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a8b18350-86b4-48f4-8a72-86516f7c50e8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:27.658795 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a8b18350-86b4-48f4-8a72-86516f7c50e8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:27.659229 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a8b18350-86b4-48f4-8a72-86516f7c50e8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:27.804566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a8b18350-86b4-48f4-8a72-86516f7c50e8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:27.813336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a8b18350-86b4-48f4-8a72-86516f7c50e8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.166499 Jul 21 17:35:27.813896 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 90/166] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:27 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:28.831065 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-124871c1-3f14-4d4b-83bf-0f5574d719b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:28.831714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-124871c1-3f14-4d4b-83bf-0f5574d719b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:28.839788 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-124871c1-3f14-4d4b-83bf-0f5574d719b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:28.840245 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-124871c1-3f14-4d4b-83bf-0f5574d719b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:28.841049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-124871c1-3f14-4d4b-83bf-0f5574d719b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:28.841491 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-124871c1-3f14-4d4b-83bf-0f5574d719b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:28.997393 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-124871c1-3f14-4d4b-83bf-0f5574d719b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:29.007877 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-124871c1-3f14-4d4b-83bf-0f5574d719b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.179463 Jul 21 17:35:29.012768 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 77/167] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:28 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:30.023244 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3d81ddd7-04ae-417a-9fc3-1bbac113e76a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:30.025577 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3d81ddd7-04ae-417a-9fc3-1bbac113e76a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:30.034543 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3d81ddd7-04ae-417a-9fc3-1bbac113e76a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:30.035141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3d81ddd7-04ae-417a-9fc3-1bbac113e76a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:30.036317 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3d81ddd7-04ae-417a-9fc3-1bbac113e76a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:30.037066 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3d81ddd7-04ae-417a-9fc3-1bbac113e76a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:30.042865 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=100 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:35:30.250926 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3d81ddd7-04ae-417a-9fc3-1bbac113e76a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:30.261725 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3d81ddd7-04ae-417a-9fc3-1bbac113e76a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.242434 Jul 21 17:35:30.271168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 91/168] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:30 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:31.278720 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c91f5262-ca45-44fd-9e24-202dcff13c4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:31.279351 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c91f5262-ca45-44fd-9e24-202dcff13c4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:31.285541 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c91f5262-ca45-44fd-9e24-202dcff13c4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:31.286000 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c91f5262-ca45-44fd-9e24-202dcff13c4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:31.286778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c91f5262-ca45-44fd-9e24-202dcff13c4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:31.287221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c91f5262-ca45-44fd-9e24-202dcff13c4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:31.426205 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c91f5262-ca45-44fd-9e24-202dcff13c4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:31.434099 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c91f5262-ca45-44fd-9e24-202dcff13c4e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.159833 Jul 21 17:35:31.434748 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 78/169] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:31 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:32.452322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cf39d843-b62b-4a7b-ad0c-dd8c7599a28b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:32.452994 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cf39d843-b62b-4a7b-ad0c-dd8c7599a28b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:32.461777 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cf39d843-b62b-4a7b-ad0c-dd8c7599a28b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:32.462846 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cf39d843-b62b-4a7b-ad0c-dd8c7599a28b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:32.463904 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cf39d843-b62b-4a7b-ad0c-dd8c7599a28b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:32.464383 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cf39d843-b62b-4a7b-ad0c-dd8c7599a28b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:32.604662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-cf39d843-b62b-4a7b-ad0c-dd8c7599a28b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:32.612074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cf39d843-b62b-4a7b-ad0c-dd8c7599a28b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.163632 Jul 21 17:35:32.612671 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 92/170] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:32 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:33.629829 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-942c3ef1-faa9-4e2a-8954-af6ecebbfaac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:33.630450 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-942c3ef1-faa9-4e2a-8954-af6ecebbfaac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:33.636935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-942c3ef1-faa9-4e2a-8954-af6ecebbfaac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:33.637396 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-942c3ef1-faa9-4e2a-8954-af6ecebbfaac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:33.638171 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-942c3ef1-faa9-4e2a-8954-af6ecebbfaac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:33.638617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-942c3ef1-faa9-4e2a-8954-af6ecebbfaac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:33.782741 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-942c3ef1-faa9-4e2a-8954-af6ecebbfaac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:33.790811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-942c3ef1-faa9-4e2a-8954-af6ecebbfaac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.164737 Jul 21 17:35:33.791603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 79/171] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:33 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:34.808441 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6da091dc-fe97-473f-8c4e-69b2f9e81812 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:34.809140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6da091dc-fe97-473f-8c4e-69b2f9e81812 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:34.815636 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6da091dc-fe97-473f-8c4e-69b2f9e81812 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:34.816153 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6da091dc-fe97-473f-8c4e-69b2f9e81812 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:34.821205 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6da091dc-fe97-473f-8c4e-69b2f9e81812 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:34.822142 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6da091dc-fe97-473f-8c4e-69b2f9e81812 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:34.984061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6da091dc-fe97-473f-8c4e-69b2f9e81812 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:34.991796 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6da091dc-fe97-473f-8c4e-69b2f9e81812 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.188339 Jul 21 17:35:34.992490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 93/172] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:34 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:36.013886 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7d2f5221-98c5-4169-8a41-5e09f00b3fe4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:36.014874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7d2f5221-98c5-4169-8a41-5e09f00b3fe4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:36.021294 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d2f5221-98c5-4169-8a41-5e09f00b3fe4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:36.021746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d2f5221-98c5-4169-8a41-5e09f00b3fe4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:36.022517 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d2f5221-98c5-4169-8a41-5e09f00b3fe4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:36.022958 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d2f5221-98c5-4169-8a41-5e09f00b3fe4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:36.042074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:35:36.172209 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7d2f5221-98c5-4169-8a41-5e09f00b3fe4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:36.181619 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7d2f5221-98c5-4169-8a41-5e09f00b3fe4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.172081 Jul 21 17:35:36.182327 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 80/173] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:36 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:37.199756 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f29ca855-b600-4f5b-bd6c-e1218d0d115d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:37.200270 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f29ca855-b600-4f5b-bd6c-e1218d0d115d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:37.202221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=38 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:35:37.207767 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f29ca855-b600-4f5b-bd6c-e1218d0d115d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:37.208445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f29ca855-b600-4f5b-bd6c-e1218d0d115d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:37.209547 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f29ca855-b600-4f5b-bd6c-e1218d0d115d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:37.209979 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f29ca855-b600-4f5b-bd6c-e1218d0d115d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:37.348583 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f29ca855-b600-4f5b-bd6c-e1218d0d115d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:37.356005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f29ca855-b600-4f5b-bd6c-e1218d0d115d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.161450 Jul 21 17:35:37.356603 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 94/174] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:37 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:38.372972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a246b3c6-8b9c-4c88-8a0b-f6f82e42ec16 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:38.373686 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a246b3c6-8b9c-4c88-8a0b-f6f82e42ec16 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:38.376227 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=38 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:35:38.381763 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a246b3c6-8b9c-4c88-8a0b-f6f82e42ec16 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:38.382218 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a246b3c6-8b9c-4c88-8a0b-f6f82e42ec16 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:38.382997 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a246b3c6-8b9c-4c88-8a0b-f6f82e42ec16 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:38.383436 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a246b3c6-8b9c-4c88-8a0b-f6f82e42ec16 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:38.533479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a246b3c6-8b9c-4c88-8a0b-f6f82e42ec16 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:38.541246 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a246b3c6-8b9c-4c88-8a0b-f6f82e42ec16 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.172345 Jul 21 17:35:38.541813 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 81/175] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:38 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:39.558211 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bf95e890-9091-410e-91ba-ab49508b0c23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:39.558824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bf95e890-9091-410e-91ba-ab49508b0c23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:39.565280 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bf95e890-9091-410e-91ba-ab49508b0c23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:39.565747 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bf95e890-9091-410e-91ba-ab49508b0c23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:39.566511 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bf95e890-9091-410e-91ba-ab49508b0c23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:39.566996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bf95e890-9091-410e-91ba-ab49508b0c23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:39.709264 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-bf95e890-9091-410e-91ba-ab49508b0c23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:39.717845 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bf95e890-9091-410e-91ba-ab49508b0c23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.163646 Jul 21 17:35:39.718495 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 95/176] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:39 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:40.735006 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a728f31-eab6-46d5-912b-a6ef3648b87b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:40.735755 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4a728f31-eab6-46d5-912b-a6ef3648b87b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:40.743434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a728f31-eab6-46d5-912b-a6ef3648b87b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:40.744041 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a728f31-eab6-46d5-912b-a6ef3648b87b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:40.744865 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a728f31-eab6-46d5-912b-a6ef3648b87b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:40.745309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a728f31-eab6-46d5-912b-a6ef3648b87b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:40.887477 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4a728f31-eab6-46d5-912b-a6ef3648b87b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:40.895540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4a728f31-eab6-46d5-912b-a6ef3648b87b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.164482 Jul 21 17:35:40.896125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 82/177] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:40 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:41.913283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-66395310-e66b-42df-890f-054eda6b91fc tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:41.913901 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-66395310-e66b-42df-890f-054eda6b91fc tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:41.920207 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-66395310-e66b-42df-890f-054eda6b91fc tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:41.920684 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-66395310-e66b-42df-890f-054eda6b91fc tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:41.921455 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-66395310-e66b-42df-890f-054eda6b91fc tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:41.921893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-66395310-e66b-42df-890f-054eda6b91fc tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:42.051585 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-66395310-e66b-42df-890f-054eda6b91fc tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:42.059657 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-66395310-e66b-42df-890f-054eda6b91fc tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.150178 Jul 21 17:35:42.060228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 96/178] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:41 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:43.077203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b18b95ac-1cc1-4581-9658-c13219bed9b1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:43.077829 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b18b95ac-1cc1-4581-9658-c13219bed9b1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:43.084363 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b18b95ac-1cc1-4581-9658-c13219bed9b1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:43.084834 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b18b95ac-1cc1-4581-9658-c13219bed9b1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:43.085888 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b18b95ac-1cc1-4581-9658-c13219bed9b1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:43.086336 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b18b95ac-1cc1-4581-9658-c13219bed9b1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:43.212275 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b18b95ac-1cc1-4581-9658-c13219bed9b1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:43.220701 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b18b95ac-1cc1-4581-9658-c13219bed9b1 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.147055 Jul 21 17:35:43.221270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 83/179] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:43 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:44.237498 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1f8aad83-ccdc-40f3-9123-45cdaca75c7d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:44.238150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1f8aad83-ccdc-40f3-9123-45cdaca75c7d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:44.245654 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1f8aad83-ccdc-40f3-9123-45cdaca75c7d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:44.246120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1f8aad83-ccdc-40f3-9123-45cdaca75c7d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:44.246896 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1f8aad83-ccdc-40f3-9123-45cdaca75c7d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:44.247344 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1f8aad83-ccdc-40f3-9123-45cdaca75c7d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:44.381352 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1f8aad83-ccdc-40f3-9123-45cdaca75c7d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:44.389235 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1f8aad83-ccdc-40f3-9123-45cdaca75c7d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.155939 Jul 21 17:35:44.389815 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 97/180] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:44 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:45.405261 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-43a97f2e-fa15-484d-9635-dcad7469e8bf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:45.407289 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-43a97f2e-fa15-484d-9635-dcad7469e8bf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:45.414431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-43a97f2e-fa15-484d-9635-dcad7469e8bf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:45.415717 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-43a97f2e-fa15-484d-9635-dcad7469e8bf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:45.416591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-43a97f2e-fa15-484d-9635-dcad7469e8bf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:45.417063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-43a97f2e-fa15-484d-9635-dcad7469e8bf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:45.551132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-43a97f2e-fa15-484d-9635-dcad7469e8bf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:45.559283 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-43a97f2e-fa15-484d-9635-dcad7469e8bf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.157925 Jul 21 17:35:45.559847 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 84/181] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:45 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:46.513476 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-25301e71-4412-4969-95e3-7cef1b88b14c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f357372-21f9-454e-aa51-d43841c91883", "device": "/dev/sdb"}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:35:46.515037 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-25301e71-4412-4969-95e3-7cef1b88b14c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:46.521108 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25301e71-4412-4969-95e3-7cef1b88b14c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:46.521560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25301e71-4412-4969-95e3-7cef1b88b14c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:46.522324 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25301e71-4412-4969-95e3-7cef1b88b14c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:46.522761 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25301e71-4412-4969-95e3-7cef1b88b14c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:46.576272 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-756fb1e5-036d-43c5-9c5a-4e0022fdea1e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:46.576941 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-756fb1e5-036d-43c5-9c5a-4e0022fdea1e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:46.583315 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-756fb1e5-036d-43c5-9c5a-4e0022fdea1e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:46.583761 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-756fb1e5-036d-43c5-9c5a-4e0022fdea1e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:46.584570 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-756fb1e5-036d-43c5-9c5a-4e0022fdea1e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:46.585013 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-756fb1e5-036d-43c5-9c5a-4e0022fdea1e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:46.720211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-756fb1e5-036d-43c5-9c5a-4e0022fdea1e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:46.727698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-756fb1e5-036d-43c5-9c5a-4e0022fdea1e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.155554 Jul 21 17:35:46.728271 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 85/182] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:46 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:35:47.744155 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7b0b2252-0b80-4442-b077-a7fd05698e94 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:47.744809 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7b0b2252-0b80-4442-b077-a7fd05698e94 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:47.751127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b0b2252-0b80-4442-b077-a7fd05698e94 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:47.751572 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b0b2252-0b80-4442-b077-a7fd05698e94 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:47.752354 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b0b2252-0b80-4442-b077-a7fd05698e94 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:47.752794 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b0b2252-0b80-4442-b077-a7fd05698e94 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:47.880365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7b0b2252-0b80-4442-b077-a7fd05698e94 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:47.888528 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7b0b2252-0b80-4442-b077-a7fd05698e94 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.148318 Jul 21 17:35:47.889108 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 86/183] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:47 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:35:48.905935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-919adf78-61b7-4abc-8cb4-ab992eaa5662 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:48.906592 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-919adf78-61b7-4abc-8cb4-ab992eaa5662 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:48.913106 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-919adf78-61b7-4abc-8cb4-ab992eaa5662 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:48.913555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-919adf78-61b7-4abc-8cb4-ab992eaa5662 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:48.914321 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-919adf78-61b7-4abc-8cb4-ab992eaa5662 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:48.915953 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-919adf78-61b7-4abc-8cb4-ab992eaa5662 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:49.047650 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-919adf78-61b7-4abc-8cb4-ab992eaa5662 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:49.055931 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-919adf78-61b7-4abc-8cb4-ab992eaa5662 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.153754 Jul 21 17:35:49.056778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 87/184] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:48 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:35:49.564244 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-25301e71-4412-4969-95e3-7cef1b88b14c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "POST /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.054514 Jul 21 17:35:49.564876 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 98/185] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 17:35:46 2022] POST /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1/os-volume_attachments => generated 194 bytes in 3057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:35:50.073585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f2e0a377-468e-4ca4-847a-a72498820371 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:50.074205 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f2e0a377-468e-4ca4-847a-a72498820371 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:50.080690 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2e0a377-468e-4ca4-847a-a72498820371 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:50.081138 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2e0a377-468e-4ca4-847a-a72498820371 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:50.081900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2e0a377-468e-4ca4-847a-a72498820371 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:50.082340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2e0a377-468e-4ca4-847a-a72498820371 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:50.210816 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f2e0a377-468e-4ca4-847a-a72498820371 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:50.218492 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f2e0a377-468e-4ca4-847a-a72498820371 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1523 microversion: 2.1 time: 0.149523 Jul 21 17:35:50.219056 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 88/186] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:50 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:51.069452 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d271871d-5cd2-4c12-8b58-60f287d5b842 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:51.070029 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d271871d-5cd2-4c12-8b58-60f287d5b842 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:51.077213 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d271871d-5cd2-4c12-8b58-60f287d5b842 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:51.077661 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d271871d-5cd2-4c12-8b58-60f287d5b842 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:51.078419 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d271871d-5cd2-4c12-8b58-60f287d5b842 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:51.078847 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d271871d-5cd2-4c12-8b58-60f287d5b842 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:51.101265 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d271871d-5cd2-4c12-8b58-60f287d5b842 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/ips" status: 200 len: 145 microversion: 2.1 time: 0.036552 Jul 21 17:35:51.101823 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 99/187] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 17:35:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:35:51.235096 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-372e2d7c-31f7-4055-bcb3-5b51b93097f9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:51.235641 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-372e2d7c-31f7-4055-bcb3-5b51b93097f9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:51.241862 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-372e2d7c-31f7-4055-bcb3-5b51b93097f9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:51.242321 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-372e2d7c-31f7-4055-bcb3-5b51b93097f9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:51.243871 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-372e2d7c-31f7-4055-bcb3-5b51b93097f9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:51.244331 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-372e2d7c-31f7-4055-bcb3-5b51b93097f9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:51.382725 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-372e2d7c-31f7-4055-bcb3-5b51b93097f9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:51.390854 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-372e2d7c-31f7-4055-bcb3-5b51b93097f9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1503 microversion: 2.1 time: 0.159887 Jul 21 17:35:51.391420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 89/188] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:51 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:51.406963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5c44338e-9a9a-40e7-9acf-7604ded50d74 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:51.407573 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5c44338e-9a9a-40e7-9acf-7604ded50d74 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:51.413992 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c44338e-9a9a-40e7-9acf-7604ded50d74 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:51.415078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c44338e-9a9a-40e7-9acf-7604ded50d74 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:51.415846 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c44338e-9a9a-40e7-9acf-7604ded50d74 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:51.416275 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c44338e-9a9a-40e7-9acf-7604ded50d74 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:51.549812 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5c44338e-9a9a-40e7-9acf-7604ded50d74 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:51.557915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5c44338e-9a9a-40e7-9acf-7604ded50d74 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1516 microversion: 2.1 time: 0.154701 Jul 21 17:35:51.558473 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 100/189] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:51 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:52.950843 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a0d51e50-563d-47fb-8a38-be7a16e9897b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:35:52.951906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a0d51e50-563d-47fb-8a38-be7a16e9897b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:52.959642 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a0d51e50-563d-47fb-8a38-be7a16e9897b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:52.960098 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a0d51e50-563d-47fb-8a38-be7a16e9897b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:52.960915 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a0d51e50-563d-47fb-8a38-be7a16e9897b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:52.962260 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a0d51e50-563d-47fb-8a38-be7a16e9897b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:52.984508 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-a0d51e50-563d-47fb-8a38-be7a16e9897b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lazy-loading 'flavor' on Instance uuid f2b7093e-b70d-4a59-bc9a-e08264c48761 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 17:35:53.053662 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a0d51e50-563d-47fb-8a38-be7a16e9897b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "POST /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761/action" status: 200 len: 32 microversion: 2.1 time: 0.106980 Jul 21 17:35:53.054321 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 90/190] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 17:35:52 2022] POST /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761/action => generated 32 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 17:35:53.064196 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e6053165-7233-4b76-93d2-2fee60775dc2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:53.064839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e6053165-7233-4b76-93d2-2fee60775dc2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:53.072723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6053165-7233-4b76-93d2-2fee60775dc2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:53.073165 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6053165-7233-4b76-93d2-2fee60775dc2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:53.073933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6053165-7233-4b76-93d2-2fee60775dc2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:53.074368 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6053165-7233-4b76-93d2-2fee60775dc2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:53.290390 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e6053165-7233-4b76-93d2-2fee60775dc2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:53.297845 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e6053165-7233-4b76-93d2-2fee60775dc2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.237407 Jul 21 17:35:53.298416 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 101/191] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:53 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:54.317411 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-10c1adfa-4b5c-42da-9762-a47d1ccffe1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:54.318059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-10c1adfa-4b5c-42da-9762-a47d1ccffe1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:54.325746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10c1adfa-4b5c-42da-9762-a47d1ccffe1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:54.326676 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10c1adfa-4b5c-42da-9762-a47d1ccffe1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:54.327142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10c1adfa-4b5c-42da-9762-a47d1ccffe1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:54.327585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10c1adfa-4b5c-42da-9762-a47d1ccffe1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:54.469703 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-10c1adfa-4b5c-42da-9762-a47d1ccffe1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:54.478817 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-10c1adfa-4b5c-42da-9762-a47d1ccffe1d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.166329 Jul 21 17:35:54.479629 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 91/192] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:54 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:55.496392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e9692b85-a160-42a9-9ef6-4ee823092a0d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:55.496989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e9692b85-a160-42a9-9ef6-4ee823092a0d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:55.503445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e9692b85-a160-42a9-9ef6-4ee823092a0d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:55.503888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e9692b85-a160-42a9-9ef6-4ee823092a0d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:55.504669 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e9692b85-a160-42a9-9ef6-4ee823092a0d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:55.505103 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e9692b85-a160-42a9-9ef6-4ee823092a0d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:55.631394 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e9692b85-a160-42a9-9ef6-4ee823092a0d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:55.639365 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e9692b85-a160-42a9-9ef6-4ee823092a0d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.147424 Jul 21 17:35:55.639934 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 102/193] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:55 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:56.655708 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-265dba58-185e-4f07-97bc-34c63ab6ec9e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:56.656362 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-265dba58-185e-4f07-97bc-34c63ab6ec9e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:56.662932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-265dba58-185e-4f07-97bc-34c63ab6ec9e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:56.663389 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-265dba58-185e-4f07-97bc-34c63ab6ec9e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:56.664152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-265dba58-185e-4f07-97bc-34c63ab6ec9e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:56.664626 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-265dba58-185e-4f07-97bc-34c63ab6ec9e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:56.790796 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-265dba58-185e-4f07-97bc-34c63ab6ec9e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:56.798347 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-265dba58-185e-4f07-97bc-34c63ab6ec9e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.146509 Jul 21 17:35:56.798914 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 92/194] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:56 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:57.659334 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d38c2540-c908-4535-8ef6-465087cb8ecb tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:57.659844 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d38c2540-c908-4535-8ef6-465087cb8ecb tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:57.666954 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d38c2540-c908-4535-8ef6-465087cb8ecb tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:57.667404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d38c2540-c908-4535-8ef6-465087cb8ecb tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:57.668166 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d38c2540-c908-4535-8ef6-465087cb8ecb tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:57.668631 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d38c2540-c908-4535-8ef6-465087cb8ecb tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:57.691283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d38c2540-c908-4535-8ef6-465087cb8ecb tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575/ips" status: 200 len: 150 microversion: 2.1 time: 0.035758 Jul 21 17:35:57.691831 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 103/195] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 17:35:57 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:35:57.816677 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-39266673-d17c-4b36-80c3-e2aee1bc684a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:57.817318 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-39266673-d17c-4b36-80c3-e2aee1bc684a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:57.824568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39266673-d17c-4b36-80c3-e2aee1bc684a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:57.825027 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39266673-d17c-4b36-80c3-e2aee1bc684a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:57.825800 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39266673-d17c-4b36-80c3-e2aee1bc684a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:57.826253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39266673-d17c-4b36-80c3-e2aee1bc684a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:57.997850 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-39266673-d17c-4b36-80c3-e2aee1bc684a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:58.006898 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-39266673-d17c-4b36-80c3-e2aee1bc684a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.195436 Jul 21 17:35:58.007481 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 93/196] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:57 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:58.270806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b2abec63-e0f5-4a10-8d54-1106c8246739 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9895b125-ae13-4a2b-9454-8649790b38ad"}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:35:58.271933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b2abec63-e0f5-4a10-8d54-1106c8246739 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:58.278214 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b2abec63-e0f5-4a10-8d54-1106c8246739 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:58.278666 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b2abec63-e0f5-4a10-8d54-1106c8246739 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:58.279716 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b2abec63-e0f5-4a10-8d54-1106c8246739 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:58.280160 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b2abec63-e0f5-4a10-8d54-1106c8246739 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:58.573441 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b2abec63-e0f5-4a10-8d54-1106c8246739 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "POST /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306187 Jul 21 17:35:58.574075 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 104/197] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 17:35:58 2022] POST /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:35:59.025786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4d41b247-4ebb-4913-b9d0-a0c084d917b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:35:59.026956 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4d41b247-4ebb-4913-b9d0-a0c084d917b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:59.034187 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d41b247-4ebb-4913-b9d0-a0c084d917b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:59.034947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d41b247-4ebb-4913-b9d0-a0c084d917b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:59.036054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d41b247-4ebb-4913-b9d0-a0c084d917b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:59.036675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d41b247-4ebb-4913-b9d0-a0c084d917b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:59.062360 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-43a3036a-6485-4e08-bfe4-322e3d7dd8e4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d38747da-5d72-42f2-abad-600f122d140c"}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:35:59.063566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-43a3036a-6485-4e08-bfe4-322e3d7dd8e4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:35:59.070033 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-43a3036a-6485-4e08-bfe4-322e3d7dd8e4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:59.071091 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-43a3036a-6485-4e08-bfe4-322e3d7dd8e4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:59.072121 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-43a3036a-6485-4e08-bfe4-322e3d7dd8e4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:35:59.072608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-43a3036a-6485-4e08-bfe4-322e3d7dd8e4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:35:59.149800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:35:59.177202 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4d41b247-4ebb-4913-b9d0-a0c084d917b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:35:59.184763 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4d41b247-4ebb-4913-b9d0-a0c084d917b9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.164232 Jul 21 17:35:59.185328 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 94/198] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:35:59 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:35:59.676604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-43a3036a-6485-4e08-bfe4-322e3d7dd8e4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "POST /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.618791 Jul 21 17:35:59.677546 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 105/199] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 17:35:59 2022] POST /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:36:00.201887 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e23d64cd-3d5f-459e-9551-1c7c1975b330 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:00.202403 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e23d64cd-3d5f-459e-9551-1c7c1975b330 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:00.208875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e23d64cd-3d5f-459e-9551-1c7c1975b330 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:00.209321 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e23d64cd-3d5f-459e-9551-1c7c1975b330 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:00.210070 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e23d64cd-3d5f-459e-9551-1c7c1975b330 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:00.210507 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e23d64cd-3d5f-459e-9551-1c7c1975b330 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:00.215016 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:36:00.341769 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e23d64cd-3d5f-459e-9551-1c7c1975b330 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:00.352659 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e23d64cd-3d5f-459e-9551-1c7c1975b330 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.154668 Jul 21 17:36:00.353228 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 95/200] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:00 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:01.371115 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4e9cf4ee-8194-4e43-ad27-5c325f4e7cc0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:01.371817 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4e9cf4ee-8194-4e43-ad27-5c325f4e7cc0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:01.378546 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4e9cf4ee-8194-4e43-ad27-5c325f4e7cc0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:01.378994 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4e9cf4ee-8194-4e43-ad27-5c325f4e7cc0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:01.379755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4e9cf4ee-8194-4e43-ad27-5c325f4e7cc0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:01.380193 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4e9cf4ee-8194-4e43-ad27-5c325f4e7cc0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:01.508627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4e9cf4ee-8194-4e43-ad27-5c325f4e7cc0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:01.516175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4e9cf4ee-8194-4e43-ad27-5c325f4e7cc0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.149950 Jul 21 17:36:01.516779 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 106/201] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:01 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:02.533355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d631465b-46bf-4ac3-91f3-44acefa5a36b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:02.534039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d631465b-46bf-4ac3-91f3-44acefa5a36b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:02.545785 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d631465b-46bf-4ac3-91f3-44acefa5a36b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:02.546289 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d631465b-46bf-4ac3-91f3-44acefa5a36b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:02.547119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d631465b-46bf-4ac3-91f3-44acefa5a36b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:02.547570 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d631465b-46bf-4ac3-91f3-44acefa5a36b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:02.765331 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d631465b-46bf-4ac3-91f3-44acefa5a36b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:02.773407 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d631465b-46bf-4ac3-91f3-44acefa5a36b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.243758 Jul 21 17:36:02.774104 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 96/202] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:02 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:03.790988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d6bcf07e-c654-4b42-8d1b-823a9ca832be tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:03.791753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d6bcf07e-c654-4b42-8d1b-823a9ca832be tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:03.798721 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d6bcf07e-c654-4b42-8d1b-823a9ca832be tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:03.799415 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d6bcf07e-c654-4b42-8d1b-823a9ca832be tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:03.800626 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d6bcf07e-c654-4b42-8d1b-823a9ca832be tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:03.800871 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d6bcf07e-c654-4b42-8d1b-823a9ca832be tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:03.948192 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d6bcf07e-c654-4b42-8d1b-823a9ca832be tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:03.956122 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d6bcf07e-c654-4b42-8d1b-823a9ca832be tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.169704 Jul 21 17:36:03.956782 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 107/203] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:03 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:04.973102 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9dedc258-bc71-48f1-9352-08bb8f988dfd tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:04.973712 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9dedc258-bc71-48f1-9352-08bb8f988dfd tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:04.980967 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dedc258-bc71-48f1-9352-08bb8f988dfd tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:04.981493 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dedc258-bc71-48f1-9352-08bb8f988dfd tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:04.982260 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dedc258-bc71-48f1-9352-08bb8f988dfd tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:04.982693 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dedc258-bc71-48f1-9352-08bb8f988dfd tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:05.114096 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9dedc258-bc71-48f1-9352-08bb8f988dfd tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:05.122190 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9dedc258-bc71-48f1-9352-08bb8f988dfd tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.152892 Jul 21 17:36:05.122749 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 97/204] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:04 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:06.139599 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9c1692ac-2eff-4a18-927d-2a21581b211a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:06.140208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9c1692ac-2eff-4a18-927d-2a21581b211a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:06.148584 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9c1692ac-2eff-4a18-927d-2a21581b211a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:06.149064 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9c1692ac-2eff-4a18-927d-2a21581b211a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:06.149842 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9c1692ac-2eff-4a18-927d-2a21581b211a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:06.150322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9c1692ac-2eff-4a18-927d-2a21581b211a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:06.280285 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9c1692ac-2eff-4a18-927d-2a21581b211a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:06.287777 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9c1692ac-2eff-4a18-927d-2a21581b211a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.151940 Jul 21 17:36:06.288361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 108/205] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:06 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:07.304722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ca7881e6-fa1a-46e2-888f-e2aa7355408c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:07.305885 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ca7881e6-fa1a-46e2-888f-e2aa7355408c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:07.312415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ca7881e6-fa1a-46e2-888f-e2aa7355408c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:07.312817 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ca7881e6-fa1a-46e2-888f-e2aa7355408c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:07.313582 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ca7881e6-fa1a-46e2-888f-e2aa7355408c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:07.314025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ca7881e6-fa1a-46e2-888f-e2aa7355408c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:07.441037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ca7881e6-fa1a-46e2-888f-e2aa7355408c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:07.449462 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ca7881e6-fa1a-46e2-888f-e2aa7355408c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.148556 Jul 21 17:36:07.450025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 98/206] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:07 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:08.465915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-070680fa-afe5-4b11-91d4-d6085dde49a3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:08.466532 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-070680fa-afe5-4b11-91d4-d6085dde49a3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:08.469036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=30 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:36:08.474333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-070680fa-afe5-4b11-91d4-d6085dde49a3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:08.474787 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-070680fa-afe5-4b11-91d4-d6085dde49a3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:08.475553 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-070680fa-afe5-4b11-91d4-d6085dde49a3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:08.475991 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-070680fa-afe5-4b11-91d4-d6085dde49a3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:08.606583 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-070680fa-afe5-4b11-91d4-d6085dde49a3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:08.614005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-070680fa-afe5-4b11-91d4-d6085dde49a3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.152078 Jul 21 17:36:08.614578 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 109/207] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:08 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:09.631562 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-59deb6eb-35f2-49c4-8f06-618eedc99ac6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:09.632185 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-59deb6eb-35f2-49c4-8f06-618eedc99ac6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:09.635070 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=36 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:36:09.640399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59deb6eb-35f2-49c4-8f06-618eedc99ac6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:09.640859 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59deb6eb-35f2-49c4-8f06-618eedc99ac6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:09.641636 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59deb6eb-35f2-49c4-8f06-618eedc99ac6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:09.642079 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59deb6eb-35f2-49c4-8f06-618eedc99ac6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:09.773743 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-59deb6eb-35f2-49c4-8f06-618eedc99ac6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:09.781311 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-59deb6eb-35f2-49c4-8f06-618eedc99ac6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.153659 Jul 21 17:36:09.781895 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 99/208] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:09 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:10.798275 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f5f8407f-b3b0-48d2-a0a8-d4c1ff6be040 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:10.798881 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f5f8407f-b3b0-48d2-a0a8-d4c1ff6be040 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:10.805496 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f5f8407f-b3b0-48d2-a0a8-d4c1ff6be040 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:10.805938 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f5f8407f-b3b0-48d2-a0a8-d4c1ff6be040 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:10.806700 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f5f8407f-b3b0-48d2-a0a8-d4c1ff6be040 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:10.807136 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f5f8407f-b3b0-48d2-a0a8-d4c1ff6be040 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:10.935637 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f5f8407f-b3b0-48d2-a0a8-d4c1ff6be040 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:10.943908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f5f8407f-b3b0-48d2-a0a8-d4c1ff6be040 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.149464 Jul 21 17:36:10.944515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 110/209] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:10 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:11.962381 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6588c6e1-2335-4a8c-85b7-d1e9ad4e0e01 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:11.962999 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6588c6e1-2335-4a8c-85b7-d1e9ad4e0e01 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:11.969506 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6588c6e1-2335-4a8c-85b7-d1e9ad4e0e01 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:11.969958 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6588c6e1-2335-4a8c-85b7-d1e9ad4e0e01 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:11.970752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6588c6e1-2335-4a8c-85b7-d1e9ad4e0e01 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:11.971190 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6588c6e1-2335-4a8c-85b7-d1e9ad4e0e01 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:12.102837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6588c6e1-2335-4a8c-85b7-d1e9ad4e0e01 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:12.109971 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6588c6e1-2335-4a8c-85b7-d1e9ad4e0e01 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.152019 Jul 21 17:36:12.110741 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 100/210] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:11 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:13.127528 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-870144e9-8d3a-4b21-9259-fea01f30054f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:13.128150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-870144e9-8d3a-4b21-9259-fea01f30054f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:13.135423 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-870144e9-8d3a-4b21-9259-fea01f30054f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:13.135876 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-870144e9-8d3a-4b21-9259-fea01f30054f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:13.136678 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-870144e9-8d3a-4b21-9259-fea01f30054f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:13.137161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-870144e9-8d3a-4b21-9259-fea01f30054f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:13.265734 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-870144e9-8d3a-4b21-9259-fea01f30054f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:13.273474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-870144e9-8d3a-4b21-9259-fea01f30054f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.149971 Jul 21 17:36:13.274787 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 111/211] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:13 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:14.291845 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c3b76e68-442c-4647-9192-13b8ffadfc98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:14.292561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c3b76e68-442c-4647-9192-13b8ffadfc98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:14.299159 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3b76e68-442c-4647-9192-13b8ffadfc98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:14.299606 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3b76e68-442c-4647-9192-13b8ffadfc98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:14.300397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3b76e68-442c-4647-9192-13b8ffadfc98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:14.300838 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c3b76e68-442c-4647-9192-13b8ffadfc98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:14.432476 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c3b76e68-442c-4647-9192-13b8ffadfc98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:14.440011 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c3b76e68-442c-4647-9192-13b8ffadfc98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.152859 Jul 21 17:36:14.449868 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 101/212] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:14 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:15.457709 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e2d52149-2c36-49ce-8ff9-2222d8f5dc3c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:15.457709 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e2d52149-2c36-49ce-8ff9-2222d8f5dc3c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:15.464579 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2d52149-2c36-49ce-8ff9-2222d8f5dc3c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:15.465034 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2d52149-2c36-49ce-8ff9-2222d8f5dc3c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:15.465804 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2d52149-2c36-49ce-8ff9-2222d8f5dc3c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:15.466260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2d52149-2c36-49ce-8ff9-2222d8f5dc3c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:15.600852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e2d52149-2c36-49ce-8ff9-2222d8f5dc3c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:15.608730 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e2d52149-2c36-49ce-8ff9-2222d8f5dc3c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.155761 Jul 21 17:36:15.609301 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 112/213] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:15 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:16.626256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-695a3c65-0c6a-471a-b0bb-1c6c68a9308b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:16.626865 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-695a3c65-0c6a-471a-b0bb-1c6c68a9308b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:16.633304 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-695a3c65-0c6a-471a-b0bb-1c6c68a9308b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:16.634567 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-695a3c65-0c6a-471a-b0bb-1c6c68a9308b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:16.635539 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-695a3c65-0c6a-471a-b0bb-1c6c68a9308b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:16.635982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-695a3c65-0c6a-471a-b0bb-1c6c68a9308b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:16.763537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-695a3c65-0c6a-471a-b0bb-1c6c68a9308b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:16.770983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-695a3c65-0c6a-471a-b0bb-1c6c68a9308b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.148578 Jul 21 17:36:16.771547 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 102/214] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:16 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:17.787741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ac06de5b-d360-41b4-8376-9ce5df15edba tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:17.788392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ac06de5b-d360-41b4-8376-9ce5df15edba tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:17.794608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ac06de5b-d360-41b4-8376-9ce5df15edba tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:17.795056 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ac06de5b-d360-41b4-8376-9ce5df15edba tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:17.795812 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ac06de5b-d360-41b4-8376-9ce5df15edba tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:17.796247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ac06de5b-d360-41b4-8376-9ce5df15edba tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:17.924975 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ac06de5b-d360-41b4-8376-9ce5df15edba tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:17.933019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ac06de5b-d360-41b4-8376-9ce5df15edba tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.149017 Jul 21 17:36:17.933591 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 113/215] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:17 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:18.950117 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9ad189b3-5d00-4429-8520-43d3f62129de tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:18.950736 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9ad189b3-5d00-4429-8520-43d3f62129de tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:18.957295 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ad189b3-5d00-4429-8520-43d3f62129de tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:18.957744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ad189b3-5d00-4429-8520-43d3f62129de tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:18.958511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ad189b3-5d00-4429-8520-43d3f62129de tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:18.958951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ad189b3-5d00-4429-8520-43d3f62129de tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:19.088637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9ad189b3-5d00-4429-8520-43d3f62129de tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:19.096027 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9ad189b3-5d00-4429-8520-43d3f62129de tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.150192 Jul 21 17:36:19.096624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 103/216] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:18 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:20.111920 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-56790107-2242-4eff-9db8-a613724ccb23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:20.112565 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-56790107-2242-4eff-9db8-a613724ccb23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:20.119729 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56790107-2242-4eff-9db8-a613724ccb23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:20.120185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56790107-2242-4eff-9db8-a613724ccb23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:20.120975 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56790107-2242-4eff-9db8-a613724ccb23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:20.121417 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56790107-2242-4eff-9db8-a613724ccb23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:20.252433 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-56790107-2242-4eff-9db8-a613724ccb23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:20.260106 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-56790107-2242-4eff-9db8-a613724ccb23 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.152041 Jul 21 17:36:20.260720 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 114/217] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:20 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:21.277330 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-99510d2d-f176-4246-ae10-8b1665b967ec tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:21.277966 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-99510d2d-f176-4246-ae10-8b1665b967ec tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:21.283983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99510d2d-f176-4246-ae10-8b1665b967ec tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:21.284462 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99510d2d-f176-4246-ae10-8b1665b967ec tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:21.285219 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99510d2d-f176-4246-ae10-8b1665b967ec tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:21.285658 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99510d2d-f176-4246-ae10-8b1665b967ec tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:21.550580 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-99510d2d-f176-4246-ae10-8b1665b967ec tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:21.559165 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-99510d2d-f176-4246-ae10-8b1665b967ec tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.285727 Jul 21 17:36:21.559729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 104/218] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:21 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:22.576798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-79a05cd2-01e7-4685-903c-6757000c7c53 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:22.577399 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-79a05cd2-01e7-4685-903c-6757000c7c53 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:22.583890 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79a05cd2-01e7-4685-903c-6757000c7c53 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:22.584379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79a05cd2-01e7-4685-903c-6757000c7c53 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:22.585143 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79a05cd2-01e7-4685-903c-6757000c7c53 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:22.585578 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79a05cd2-01e7-4685-903c-6757000c7c53 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:22.714847 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-79a05cd2-01e7-4685-903c-6757000c7c53 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:22.722632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-79a05cd2-01e7-4685-903c-6757000c7c53 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.149690 Jul 21 17:36:22.723210 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 115/219] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:22 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:23.740048 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5834752f-fcb4-4338-8a31-4e677b41f737 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:23.740598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5834752f-fcb4-4338-8a31-4e677b41f737 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:23.747701 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5834752f-fcb4-4338-8a31-4e677b41f737 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:23.748155 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5834752f-fcb4-4338-8a31-4e677b41f737 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:23.748994 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5834752f-fcb4-4338-8a31-4e677b41f737 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:23.749433 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5834752f-fcb4-4338-8a31-4e677b41f737 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:23.879996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5834752f-fcb4-4338-8a31-4e677b41f737 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:23.887851 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5834752f-fcb4-4338-8a31-4e677b41f737 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.151709 Jul 21 17:36:23.888636 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 105/220] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:23 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:24.904934 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e61283c2-6b65-48aa-bac2-12f91bd87031 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:24.905548 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e61283c2-6b65-48aa-bac2-12f91bd87031 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:24.912219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e61283c2-6b65-48aa-bac2-12f91bd87031 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:24.913136 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e61283c2-6b65-48aa-bac2-12f91bd87031 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:24.913903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e61283c2-6b65-48aa-bac2-12f91bd87031 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:24.914341 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e61283c2-6b65-48aa-bac2-12f91bd87031 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:25.059337 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e61283c2-6b65-48aa-bac2-12f91bd87031 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:25.066786 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e61283c2-6b65-48aa-bac2-12f91bd87031 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.165735 Jul 21 17:36:25.067355 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 116/221] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:24 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:26.083957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-82d74cd8-6ffd-45d5-b65b-262ae358d03f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:26.084604 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-82d74cd8-6ffd-45d5-b65b-262ae358d03f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:26.091718 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82d74cd8-6ffd-45d5-b65b-262ae358d03f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:26.092169 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82d74cd8-6ffd-45d5-b65b-262ae358d03f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:26.092970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82d74cd8-6ffd-45d5-b65b-262ae358d03f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:26.093413 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82d74cd8-6ffd-45d5-b65b-262ae358d03f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:26.223001 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-82d74cd8-6ffd-45d5-b65b-262ae358d03f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:26.230570 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-82d74cd8-6ffd-45d5-b65b-262ae358d03f tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.150352 Jul 21 17:36:26.231130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 106/222] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:26 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:27.247230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f714dd48-2695-4c28-98d5-2b3ad3dac46e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:27.247784 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f714dd48-2695-4c28-98d5-2b3ad3dac46e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:27.254468 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f714dd48-2695-4c28-98d5-2b3ad3dac46e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:27.254922 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f714dd48-2695-4c28-98d5-2b3ad3dac46e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:27.255693 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f714dd48-2695-4c28-98d5-2b3ad3dac46e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:27.256140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f714dd48-2695-4c28-98d5-2b3ad3dac46e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:27.380595 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f714dd48-2695-4c28-98d5-2b3ad3dac46e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:27.388662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f714dd48-2695-4c28-98d5-2b3ad3dac46e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.145367 Jul 21 17:36:27.389240 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 117/223] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:27 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:28.405418 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2d547b2c-e28e-4cfa-a29e-6d0b2ec99415 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:28.406037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2d547b2c-e28e-4cfa-a29e-6d0b2ec99415 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:28.412526 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d547b2c-e28e-4cfa-a29e-6d0b2ec99415 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:28.412983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d547b2c-e28e-4cfa-a29e-6d0b2ec99415 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:28.413754 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d547b2c-e28e-4cfa-a29e-6d0b2ec99415 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:28.414194 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d547b2c-e28e-4cfa-a29e-6d0b2ec99415 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:28.750064 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2d547b2c-e28e-4cfa-a29e-6d0b2ec99415 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:28.757529 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2d547b2c-e28e-4cfa-a29e-6d0b2ec99415 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.356154 Jul 21 17:36:28.758088 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 107/224] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:28 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:29.774445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dc51e9d4-2dca-408b-8144-99c65357eccf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:29.775118 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dc51e9d4-2dca-408b-8144-99c65357eccf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:29.782033 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc51e9d4-2dca-408b-8144-99c65357eccf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:29.782482 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc51e9d4-2dca-408b-8144-99c65357eccf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:29.783247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc51e9d4-2dca-408b-8144-99c65357eccf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:29.783712 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc51e9d4-2dca-408b-8144-99c65357eccf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:29.787573 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:36:29.913003 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-dc51e9d4-2dca-408b-8144-99c65357eccf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:29.920496 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dc51e9d4-2dca-408b-8144-99c65357eccf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.149843 Jul 21 17:36:29.921060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 118/225] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:29 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:30.937041 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ed117acb-9817-4a6e-99a4-92c1ca40007d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:30.937675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ed117acb-9817-4a6e-99a4-92c1ca40007d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:30.944195 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed117acb-9817-4a6e-99a4-92c1ca40007d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:30.944803 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed117acb-9817-4a6e-99a4-92c1ca40007d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:30.945563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed117acb-9817-4a6e-99a4-92c1ca40007d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:30.946000 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed117acb-9817-4a6e-99a4-92c1ca40007d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:30.948826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=77 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:36:31.080911 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ed117acb-9817-4a6e-99a4-92c1ca40007d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:31.089045 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ed117acb-9817-4a6e-99a4-92c1ca40007d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.155859 Jul 21 17:36:31.089615 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 108/226] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:30 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:32.105163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-79351f9f-63ba-4a11-a1f1-27314b4304ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:32.105786 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-79351f9f-63ba-4a11-a1f1-27314b4304ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:32.112418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79351f9f-63ba-4a11-a1f1-27314b4304ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:32.112874 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79351f9f-63ba-4a11-a1f1-27314b4304ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:32.113643 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79351f9f-63ba-4a11-a1f1-27314b4304ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:32.114078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79351f9f-63ba-4a11-a1f1-27314b4304ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:32.240088 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-79351f9f-63ba-4a11-a1f1-27314b4304ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:32.248039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-79351f9f-63ba-4a11-a1f1-27314b4304ac tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.146703 Jul 21 17:36:32.248711 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 119/227] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:32 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:33.265177 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-08da945c-1918-46b8-903f-a7063cd0c7c3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:33.265743 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-08da945c-1918-46b8-903f-a7063cd0c7c3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:33.273399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-08da945c-1918-46b8-903f-a7063cd0c7c3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:33.273852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-08da945c-1918-46b8-903f-a7063cd0c7c3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:33.275240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-08da945c-1918-46b8-903f-a7063cd0c7c3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:33.275701 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-08da945c-1918-46b8-903f-a7063cd0c7c3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:33.405239 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-08da945c-1918-46b8-903f-a7063cd0c7c3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:33.413273 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-08da945c-1918-46b8-903f-a7063cd0c7c3 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.151944 Jul 21 17:36:33.414111 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 109/228] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:33 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:34.430018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ceae6dbb-13f9-461b-bdca-4d0ff18c274d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:34.430638 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ceae6dbb-13f9-461b-bdca-4d0ff18c274d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:34.437854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ceae6dbb-13f9-461b-bdca-4d0ff18c274d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:34.438313 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ceae6dbb-13f9-461b-bdca-4d0ff18c274d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:34.439089 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ceae6dbb-13f9-461b-bdca-4d0ff18c274d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:34.439534 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ceae6dbb-13f9-461b-bdca-4d0ff18c274d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:34.572541 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ceae6dbb-13f9-461b-bdca-4d0ff18c274d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:34.579888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ceae6dbb-13f9-461b-bdca-4d0ff18c274d tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.153699 Jul 21 17:36:34.580488 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 120/229] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:34 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:35.597834 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5ab9a347-b606-4ccf-977a-a5276cd3b2ce tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:35.598454 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5ab9a347-b606-4ccf-977a-a5276cd3b2ce tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:35.605525 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ab9a347-b606-4ccf-977a-a5276cd3b2ce tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:35.606224 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ab9a347-b606-4ccf-977a-a5276cd3b2ce tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:35.607426 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ab9a347-b606-4ccf-977a-a5276cd3b2ce tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:35.608082 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ab9a347-b606-4ccf-977a-a5276cd3b2ce tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:35.744288 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5ab9a347-b606-4ccf-977a-a5276cd3b2ce tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:35.751941 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5ab9a347-b606-4ccf-977a-a5276cd3b2ce tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.157941 Jul 21 17:36:35.752760 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 110/230] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:35 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:36.769063 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-98d30e39-7110-4ac5-a19b-707742e39ce0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:36.769737 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-98d30e39-7110-4ac5-a19b-707742e39ce0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:36.776861 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98d30e39-7110-4ac5-a19b-707742e39ce0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:36.777318 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98d30e39-7110-4ac5-a19b-707742e39ce0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:36.778114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98d30e39-7110-4ac5-a19b-707742e39ce0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:36.778550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98d30e39-7110-4ac5-a19b-707742e39ce0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:37.050135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-98d30e39-7110-4ac5-a19b-707742e39ce0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:37.057697 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-98d30e39-7110-4ac5-a19b-707742e39ce0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.292355 Jul 21 17:36:37.058263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 121/231] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:36 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:38.074843 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8d4e7549-b8fb-4eab-ab30-a220e6a36236 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:38.075393 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8d4e7549-b8fb-4eab-ab30-a220e6a36236 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:38.082122 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d4e7549-b8fb-4eab-ab30-a220e6a36236 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:38.082600 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d4e7549-b8fb-4eab-ab30-a220e6a36236 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:38.083358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d4e7549-b8fb-4eab-ab30-a220e6a36236 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:38.083793 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d4e7549-b8fb-4eab-ab30-a220e6a36236 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:38.211295 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8d4e7549-b8fb-4eab-ab30-a220e6a36236 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:38.218962 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8d4e7549-b8fb-4eab-ab30-a220e6a36236 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.148472 Jul 21 17:36:38.219524 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 111/232] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:38 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:39.235935 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8bbc14cc-07d7-482c-b1eb-3493d7f0ae8b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:39.236488 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8bbc14cc-07d7-482c-b1eb-3493d7f0ae8b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:39.238833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=26 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:36:39.244791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8bbc14cc-07d7-482c-b1eb-3493d7f0ae8b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:39.245242 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8bbc14cc-07d7-482c-b1eb-3493d7f0ae8b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:39.246008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8bbc14cc-07d7-482c-b1eb-3493d7f0ae8b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:39.246442 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8bbc14cc-07d7-482c-b1eb-3493d7f0ae8b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:39.373107 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8bbc14cc-07d7-482c-b1eb-3493d7f0ae8b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:39.380476 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8bbc14cc-07d7-482c-b1eb-3493d7f0ae8b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.148461 Jul 21 17:36:39.381037 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 122/233] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:39 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:40.397609 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fdd2fd0e-7569-4ed7-a4ff-03e3cafb5d98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:40.398260 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fdd2fd0e-7569-4ed7-a4ff-03e3cafb5d98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:40.401583 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=26 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:36:40.407170 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fdd2fd0e-7569-4ed7-a4ff-03e3cafb5d98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:40.407630 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fdd2fd0e-7569-4ed7-a4ff-03e3cafb5d98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:40.408427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fdd2fd0e-7569-4ed7-a4ff-03e3cafb5d98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:40.408874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fdd2fd0e-7569-4ed7-a4ff-03e3cafb5d98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:40.539256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fdd2fd0e-7569-4ed7-a4ff-03e3cafb5d98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:40.547611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fdd2fd0e-7569-4ed7-a4ff-03e3cafb5d98 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.153961 Jul 21 17:36:40.548175 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 112/234] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:40 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:41.564881 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-90826cbd-4366-4f0f-bbc0-ea27cfe5b5a5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:41.565491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-90826cbd-4366-4f0f-bbc0-ea27cfe5b5a5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:41.572484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-90826cbd-4366-4f0f-bbc0-ea27cfe5b5a5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:41.572933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-90826cbd-4366-4f0f-bbc0-ea27cfe5b5a5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:41.573727 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-90826cbd-4366-4f0f-bbc0-ea27cfe5b5a5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:41.574184 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-90826cbd-4366-4f0f-bbc0-ea27cfe5b5a5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:41.699150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-90826cbd-4366-4f0f-bbc0-ea27cfe5b5a5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:41.707088 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-90826cbd-4366-4f0f-bbc0-ea27cfe5b5a5 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.146021 Jul 21 17:36:41.707666 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 123/235] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:41 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:42.723922 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0db5d3c4-3a79-4650-ba8b-21178559df70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:42.724556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0db5d3c4-3a79-4650-ba8b-21178559df70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:42.731077 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0db5d3c4-3a79-4650-ba8b-21178559df70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:42.731526 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0db5d3c4-3a79-4650-ba8b-21178559df70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:42.732283 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0db5d3c4-3a79-4650-ba8b-21178559df70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:42.732742 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0db5d3c4-3a79-4650-ba8b-21178559df70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:42.865669 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0db5d3c4-3a79-4650-ba8b-21178559df70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:42.873389 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0db5d3c4-3a79-4650-ba8b-21178559df70 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.153388 Jul 21 17:36:42.874166 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 113/236] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:42 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:43.890937 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-09a2ac3b-981b-40a1-b9ea-054611abb116 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:43.891546 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-09a2ac3b-981b-40a1-b9ea-054611abb116 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:43.898090 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-09a2ac3b-981b-40a1-b9ea-054611abb116 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:43.898536 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-09a2ac3b-981b-40a1-b9ea-054611abb116 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:43.899903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-09a2ac3b-981b-40a1-b9ea-054611abb116 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:43.900357 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-09a2ac3b-981b-40a1-b9ea-054611abb116 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:44.042549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-09a2ac3b-981b-40a1-b9ea-054611abb116 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:44.050013 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-09a2ac3b-981b-40a1-b9ea-054611abb116 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.163336 Jul 21 17:36:44.050573 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 124/237] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:43 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:45.066718 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f61508e1-4115-4bdf-9e32-f91fb5d055a2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:45.067355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f61508e1-4115-4bdf-9e32-f91fb5d055a2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:45.081100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f61508e1-4115-4bdf-9e32-f91fb5d055a2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:45.081566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f61508e1-4115-4bdf-9e32-f91fb5d055a2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:45.082356 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f61508e1-4115-4bdf-9e32-f91fb5d055a2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:45.082806 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f61508e1-4115-4bdf-9e32-f91fb5d055a2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:45.219168 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f61508e1-4115-4bdf-9e32-f91fb5d055a2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:45.226542 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f61508e1-4115-4bdf-9e32-f91fb5d055a2 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.163641 Jul 21 17:36:45.227100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 114/238] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:45 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:46.245460 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a7a91b6f-207a-4119-b75b-786e18cc3721 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:46.246069 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a7a91b6f-207a-4119-b75b-786e18cc3721 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:46.252553 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a7a91b6f-207a-4119-b75b-786e18cc3721 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:46.253002 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a7a91b6f-207a-4119-b75b-786e18cc3721 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:46.253767 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a7a91b6f-207a-4119-b75b-786e18cc3721 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:46.254201 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a7a91b6f-207a-4119-b75b-786e18cc3721 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:46.379863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a7a91b6f-207a-4119-b75b-786e18cc3721 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:46.387430 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a7a91b6f-207a-4119-b75b-786e18cc3721 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.146432 Jul 21 17:36:46.387998 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 125/239] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:46 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:47.404748 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-708c7420-17bb-4e89-af3b-9caf42861f24 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:47.405396 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-708c7420-17bb-4e89-af3b-9caf42861f24 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:47.411923 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-708c7420-17bb-4e89-af3b-9caf42861f24 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:47.412409 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-708c7420-17bb-4e89-af3b-9caf42861f24 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:47.413188 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-708c7420-17bb-4e89-af3b-9caf42861f24 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:47.413634 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-708c7420-17bb-4e89-af3b-9caf42861f24 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:47.543345 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-708c7420-17bb-4e89-af3b-9caf42861f24 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:47.550843 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-708c7420-17bb-4e89-af3b-9caf42861f24 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.149925 Jul 21 17:36:47.551404 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 115/240] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:47 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:48.568290 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e966ead1-44b5-48a4-8403-4933f47d8c5e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:48.568877 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e966ead1-44b5-48a4-8403-4933f47d8c5e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:48.575348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e966ead1-44b5-48a4-8403-4933f47d8c5e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:48.575802 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e966ead1-44b5-48a4-8403-4933f47d8c5e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:48.576601 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e966ead1-44b5-48a4-8403-4933f47d8c5e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:48.577046 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e966ead1-44b5-48a4-8403-4933f47d8c5e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:48.708217 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e966ead1-44b5-48a4-8403-4933f47d8c5e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:48.716584 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e966ead1-44b5-48a4-8403-4933f47d8c5e tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.152192 Jul 21 17:36:48.717147 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 126/241] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:48 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:49.733900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-59e905fa-d2f6-4458-a9f4-7b5a76d95e2a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:49.734507 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-59e905fa-d2f6-4458-a9f4-7b5a76d95e2a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:49.741130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59e905fa-d2f6-4458-a9f4-7b5a76d95e2a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:49.741574 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59e905fa-d2f6-4458-a9f4-7b5a76d95e2a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:49.742334 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59e905fa-d2f6-4458-a9f4-7b5a76d95e2a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:49.742768 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59e905fa-d2f6-4458-a9f4-7b5a76d95e2a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:49.871296 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-59e905fa-d2f6-4458-a9f4-7b5a76d95e2a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:49.878900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-59e905fa-d2f6-4458-a9f4-7b5a76d95e2a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.148880 Jul 21 17:36:49.879478 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 116/242] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:49 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:50.896158 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9eaa61e8-12d2-483e-a903-ca7487f4845b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:50.896828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9eaa61e8-12d2-483e-a903-ca7487f4845b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:50.903473 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9eaa61e8-12d2-483e-a903-ca7487f4845b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:50.903919 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9eaa61e8-12d2-483e-a903-ca7487f4845b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:50.904804 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9eaa61e8-12d2-483e-a903-ca7487f4845b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:50.905238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9eaa61e8-12d2-483e-a903-ca7487f4845b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:51.040483 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9eaa61e8-12d2-483e-a903-ca7487f4845b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:51.048146 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9eaa61e8-12d2-483e-a903-ca7487f4845b tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.155774 Jul 21 17:36:51.048746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 127/243] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:50 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:52.065572 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cfbb8255-01ea-4cd8-8395-9d066a2b1a3a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:52.066195 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cfbb8255-01ea-4cd8-8395-9d066a2b1a3a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:52.072580 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfbb8255-01ea-4cd8-8395-9d066a2b1a3a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:52.073037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfbb8255-01ea-4cd8-8395-9d066a2b1a3a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:52.073814 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfbb8255-01ea-4cd8-8395-9d066a2b1a3a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:52.074259 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfbb8255-01ea-4cd8-8395-9d066a2b1a3a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:52.204559 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cfbb8255-01ea-4cd8-8395-9d066a2b1a3a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:52.212169 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cfbb8255-01ea-4cd8-8395-9d066a2b1a3a tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.150637 Jul 21 17:36:52.212770 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 117/244] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:52 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:53.230867 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-daccd98a-26f9-4337-a1c6-f49d77f007cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:53.231390 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-daccd98a-26f9-4337-a1c6-f49d77f007cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:53.237814 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-daccd98a-26f9-4337-a1c6-f49d77f007cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:53.238271 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-daccd98a-26f9-4337-a1c6-f49d77f007cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:53.239043 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-daccd98a-26f9-4337-a1c6-f49d77f007cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:53.239489 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-daccd98a-26f9-4337-a1c6-f49d77f007cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:53.369484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-daccd98a-26f9-4337-a1c6-f49d77f007cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:53.377092 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-daccd98a-26f9-4337-a1c6-f49d77f007cf tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.150882 Jul 21 17:36:53.377691 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 128/245] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:53 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:54.393728 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ec2e3a45-78b3-47ec-9f8d-18fa29e95e5c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:54.394335 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ec2e3a45-78b3-47ec-9f8d-18fa29e95e5c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:54.401843 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ec2e3a45-78b3-47ec-9f8d-18fa29e95e5c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:54.402331 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ec2e3a45-78b3-47ec-9f8d-18fa29e95e5c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:54.403131 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ec2e3a45-78b3-47ec-9f8d-18fa29e95e5c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:54.403598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ec2e3a45-78b3-47ec-9f8d-18fa29e95e5c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:54.539594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ec2e3a45-78b3-47ec-9f8d-18fa29e95e5c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:54.548230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ec2e3a45-78b3-47ec-9f8d-18fa29e95e5c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.158320 Jul 21 17:36:54.548847 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 118/246] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:54 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:55.574350 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-363060fd-57df-45ca-bc9d-0cc2188dbea8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:55.574965 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-363060fd-57df-45ca-bc9d-0cc2188dbea8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:55.581591 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-363060fd-57df-45ca-bc9d-0cc2188dbea8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:55.583675 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-363060fd-57df-45ca-bc9d-0cc2188dbea8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:55.584943 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-363060fd-57df-45ca-bc9d-0cc2188dbea8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:55.585410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-363060fd-57df-45ca-bc9d-0cc2188dbea8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:55.726464 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-363060fd-57df-45ca-bc9d-0cc2188dbea8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:55.735097 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-363060fd-57df-45ca-bc9d-0cc2188dbea8 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.166570 Jul 21 17:36:55.735677 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 129/247] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:55 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:56.753552 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eaf39029-6f2b-4857-a4cd-6202f6211e9c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:56.754177 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eaf39029-6f2b-4857-a4cd-6202f6211e9c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:56.763480 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eaf39029-6f2b-4857-a4cd-6202f6211e9c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:56.763977 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eaf39029-6f2b-4857-a4cd-6202f6211e9c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:56.764882 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eaf39029-6f2b-4857-a4cd-6202f6211e9c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:56.765513 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eaf39029-6f2b-4857-a4cd-6202f6211e9c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:56.903968 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-eaf39029-6f2b-4857-a4cd-6202f6211e9c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:56.911435 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eaf39029-6f2b-4857-a4cd-6202f6211e9c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.161801 Jul 21 17:36:56.912010 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 119/248] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:56 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:57.735316 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d59c0004-fc16-469e-a509-bf1c918f0c86 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:36:57.742036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d59c0004-fc16-469e-a509-bf1c918f0c86 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:57.742711 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d59c0004-fc16-469e-a509-bf1c918f0c86 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:57.803821 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d59c0004-fc16-469e-a509-bf1c918f0c86 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Going to try to stop instance {{(pid=124381) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 17:36:57.853131 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d59c0004-fc16-469e-a509-bf1c918f0c86 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "POST /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/action" status: 202 len: 0 microversion: 2.1 time: 0.121458 Jul 21 17:36:57.854543 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 130/249] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 17:36:57 2022] POST /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 17:36:57.862705 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b0701fba-8583-46d8-8787-f8a80a951677 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:57.863325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b0701fba-8583-46d8-8787-f8a80a951677 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:57.870222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0701fba-8583-46d8-8787-f8a80a951677 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:57.870660 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0701fba-8583-46d8-8787-f8a80a951677 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:57.871444 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0701fba-8583-46d8-8787-f8a80a951677 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:57.871964 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0701fba-8583-46d8-8787-f8a80a951677 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:57.930247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1d02d4c6-8dae-43f5-9b26-135de91ae1f4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:57.931993 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1d02d4c6-8dae-43f5-9b26-135de91ae1f4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:57.940466 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1d02d4c6-8dae-43f5-9b26-135de91ae1f4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:57.940923 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1d02d4c6-8dae-43f5-9b26-135de91ae1f4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:57.941711 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1d02d4c6-8dae-43f5-9b26-135de91ae1f4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:57.942151 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1d02d4c6-8dae-43f5-9b26-135de91ae1f4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:58.084933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b0701fba-8583-46d8-8787-f8a80a951677 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:58.093036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b0701fba-8583-46d8-8787-f8a80a951677 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.234243 Jul 21 17:36:58.093614 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 120/250] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:57 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:36:58.131856 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1d02d4c6-8dae-43f5-9b26-135de91ae1f4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:58.139368 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1d02d4c6-8dae-43f5-9b26-135de91ae1f4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.213933 Jul 21 17:36:58.139942 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 131/251] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:57 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:36:59.110484 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d07b6e47-5daa-4b78-a6c4-c24adb56d627 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:59.111010 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d07b6e47-5daa-4b78-a6c4-c24adb56d627 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:59.117494 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d07b6e47-5daa-4b78-a6c4-c24adb56d627 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:59.117940 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d07b6e47-5daa-4b78-a6c4-c24adb56d627 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:59.118730 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d07b6e47-5daa-4b78-a6c4-c24adb56d627 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:59.119740 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d07b6e47-5daa-4b78-a6c4-c24adb56d627 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:59.156990 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2c227336-e4eb-4751-953d-977a2c06aa37 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:36:59.157738 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2c227336-e4eb-4751-953d-977a2c06aa37 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:36:59.164433 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c227336-e4eb-4751-953d-977a2c06aa37 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:59.164980 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c227336-e4eb-4751-953d-977a2c06aa37 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:59.166524 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c227336-e4eb-4751-953d-977a2c06aa37 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:36:59.167075 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c227336-e4eb-4751-953d-977a2c06aa37 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:36:59.301816 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d07b6e47-5daa-4b78-a6c4-c24adb56d627 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:59.310498 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d07b6e47-5daa-4b78-a6c4-c24adb56d627 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.203899 Jul 21 17:36:59.311085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 121/252] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:36:59.330417 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2c227336-e4eb-4751-953d-977a2c06aa37 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:36:59.337816 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2c227336-e4eb-4751-953d-977a2c06aa37 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.184695 Jul 21 17:36:59.338380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 132/253] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:36:59 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:37:00.327937 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-752051d6-76e1-4f2e-9483-e381a0e2f6cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:00.328700 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-752051d6-76e1-4f2e-9483-e381a0e2f6cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:00.335251 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-752051d6-76e1-4f2e-9483-e381a0e2f6cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:00.335715 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-752051d6-76e1-4f2e-9483-e381a0e2f6cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:00.336610 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-752051d6-76e1-4f2e-9483-e381a0e2f6cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:00.337025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-752051d6-76e1-4f2e-9483-e381a0e2f6cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:00.356018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-28f99189-150c-4369-be4b-d72bfa6cd0d6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:00.356665 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-28f99189-150c-4369-be4b-d72bfa6cd0d6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:00.363700 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-28f99189-150c-4369-be4b-d72bfa6cd0d6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:00.364150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-28f99189-150c-4369-be4b-d72bfa6cd0d6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:00.365646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-28f99189-150c-4369-be4b-d72bfa6cd0d6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:00.366087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-28f99189-150c-4369-be4b-d72bfa6cd0d6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:00.369663 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:37:00.524635 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-752051d6-76e1-4f2e-9483-e381a0e2f6cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:00.533072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-752051d6-76e1-4f2e-9483-e381a0e2f6cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.209055 Jul 21 17:37:00.533855 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 122/254] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:00.546620 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-28f99189-150c-4369-be4b-d72bfa6cd0d6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:00.554163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-28f99189-150c-4369-be4b-d72bfa6cd0d6 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1502 microversion: 2.1 time: 0.203532 Jul 21 17:37:00.554725 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 133/255] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:00 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:37:00.571350 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-84010566-cc0d-46ff-aeb8-f0cbbdfd7efa tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f69821ef-6935-49e4-9dbc-8d7afbd57f91"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:37:00.573631 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-84010566-cc0d-46ff-aeb8-f0cbbdfd7efa tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:00.580341 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84010566-cc0d-46ff-aeb8-f0cbbdfd7efa tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:00.580731 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84010566-cc0d-46ff-aeb8-f0cbbdfd7efa tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:00.581509 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84010566-cc0d-46ff-aeb8-f0cbbdfd7efa tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:00.581947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84010566-cc0d-46ff-aeb8-f0cbbdfd7efa tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:00.609741 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-84010566-cc0d-46ff-aeb8-f0cbbdfd7efa tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] HTTP exception thrown: Cannot 'attach_volume' instance f2b7093e-b70d-4a59-bc9a-e08264c48761 while it is in vm_state rescued Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-84010566-cc0d-46ff-aeb8-f0cbbdfd7efa tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Request method failure captured: Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: POST /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761/os-volume_attachments HTTP/1.1 Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 74 Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y4Wigurc0zXrCHCWwtYR8gdbXlP7tMhp1C8KrLHmYYBi72WjrUqyNf1xGxUyO6sshaPc_BNy-PWUDwstd884Ayki6iaa-IHO4U4gg8ZNrySq_2mQ6Dm5qSankL8WlsYAtpgqOoRzyTdFVQHgSPLvNziBS-HrJTcvFsuqE6-93d3t2c Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 21c11b3abe754d86919bbcf31ecb312a Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-178059006 Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 17:37:00.611587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 17:37:00.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/21c11b3abe754d86919bbcf31ecb312a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/21c11b3abe754d86919bbcf31ecb312a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_21c11b3abe754d86919bbcf31ecb312a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/21c11b3abe754d86919bbcf31ecb312a"}]}] Jul 21 17:37:00.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-ServerRescueNegativeTestJSON-178059006 Jul 21 17:37:00.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 21c11b3abe754d86919bbcf31ecb312a Jul 21 17:37:00.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-178059006 Jul 21 17:37:00.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-ServerRescueNegativeTestJSON-178059006-project Jul 21 17:37:00.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 17:37:00.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 17:37:00.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: 1bf6e7a4afaf405caae7d750973d9956 Jul 21 17:37:00.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-ServerRescueNegativeTestJSON-178059006-project Jul 21 17:37:00.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Jul 21 17:37:00.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {"volumeAttachment": {"volumeId": "f69821ef-6935-49e4-9dbc-8d7afbd57f91"}} Jul 21 17:37:00.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Cannot 'attach_volume' instance f2b7093e-b70d-4a59-bc9a-e08264c48761 while it is in vm_state rescued Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'server_id': 'f2b7093e-b70d-4a59-bc9a-e08264c48761', 'body': {'volumeAttachment': {'volumeId': 'f69821ef-6935-49e4-9dbc-8d7afbd57f91'}}} Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2b7093e-b70d-4a59-bc9a-e08264c48761 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:37:00.613554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f2b7093e-b70d-4a59-bc9a-e08264c48761 while it is in vm_state rescued Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:37:00.614638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:37:00.615912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:37:00.615912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:37:00.615912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f2b7093e-b70d-4a59-bc9a-e08264c48761 while it is in vm_state rescued Jul 21 17:37:00.615912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:37:00.615912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-84010566-cc0d-46ff-aeb8-f0cbbdfd7efa tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Returning 409 to user: Cannot 'attach_volume' instance f2b7093e-b70d-4a59-bc9a-e08264c48761 while it is in vm_state rescued {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:37:00.615912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-84010566-cc0d-46ff-aeb8-f0cbbdfd7efa tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "POST /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046080 Jul 21 17:37:00.615912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 123/256] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 17:37:00 2022] POST /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 17:37:00.623278 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dc98dfff-2f24-410c-bdb0-c41d91477173 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:37:00.623810 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dc98dfff-2f24-410c-bdb0-c41d91477173 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:00.629925 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc98dfff-2f24-410c-bdb0-c41d91477173 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:00.630378 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc98dfff-2f24-410c-bdb0-c41d91477173 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:00.631143 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc98dfff-2f24-410c-bdb0-c41d91477173 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:00.631578 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc98dfff-2f24-410c-bdb0-c41d91477173 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:00.698567 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dc98dfff-2f24-410c-bdb0-c41d91477173 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "POST /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761/action" status: 202 len: 0 microversion: 2.1 time: 0.079930 Jul 21 17:37:00.702424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 134/257] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 17:37:00 2022] POST /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 17:37:00.707754 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ef6be5f1-2655-4b33-974d-f3d04fbc24fb tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:00.708416 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ef6be5f1-2655-4b33-974d-f3d04fbc24fb tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:00.715807 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef6be5f1-2655-4b33-974d-f3d04fbc24fb tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:00.716266 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef6be5f1-2655-4b33-974d-f3d04fbc24fb tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:00.717069 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef6be5f1-2655-4b33-974d-f3d04fbc24fb tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:00.717517 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef6be5f1-2655-4b33-974d-f3d04fbc24fb tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:00.883542 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ef6be5f1-2655-4b33-974d-f3d04fbc24fb tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:00.891133 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ef6be5f1-2655-4b33-974d-f3d04fbc24fb tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1510 microversion: 2.1 time: 0.187308 Jul 21 17:37:00.899196 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 124/258] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:00 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:01.551993 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-34e8515d-177d-4ac1-b982-4a7979f14a28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:01.552850 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-34e8515d-177d-4ac1-b982-4a7979f14a28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:01.560016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-34e8515d-177d-4ac1-b982-4a7979f14a28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:01.560521 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-34e8515d-177d-4ac1-b982-4a7979f14a28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:01.561299 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-34e8515d-177d-4ac1-b982-4a7979f14a28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:01.561742 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-34e8515d-177d-4ac1-b982-4a7979f14a28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:01.692309 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-34e8515d-177d-4ac1-b982-4a7979f14a28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:01.702014 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-34e8515d-177d-4ac1-b982-4a7979f14a28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.154713 Jul 21 17:37:01.702667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 135/259] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:01 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:01.916138 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-81bfd0ba-8395-45dd-a4cd-6c016fcc5f8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:01.916873 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-81bfd0ba-8395-45dd-a4cd-6c016fcc5f8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:01.923582 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81bfd0ba-8395-45dd-a4cd-6c016fcc5f8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:01.924148 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81bfd0ba-8395-45dd-a4cd-6c016fcc5f8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:01.925002 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81bfd0ba-8395-45dd-a4cd-6c016fcc5f8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:01.925557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81bfd0ba-8395-45dd-a4cd-6c016fcc5f8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:01.932756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:37:02.057386 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-81bfd0ba-8395-45dd-a4cd-6c016fcc5f8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:02.064828 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-81bfd0ba-8395-45dd-a4cd-6c016fcc5f8c tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1510 microversion: 2.1 time: 0.152672 Jul 21 17:37:02.065387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 125/260] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:01 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:02.719708 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c20c2254-a76d-4777-b168-b64966959e6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:02.720335 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c20c2254-a76d-4777-b168-b64966959e6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:02.726800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c20c2254-a76d-4777-b168-b64966959e6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:02.727249 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c20c2254-a76d-4777-b168-b64966959e6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:02.728012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c20c2254-a76d-4777-b168-b64966959e6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:02.728729 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c20c2254-a76d-4777-b168-b64966959e6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:02.858143 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c20c2254-a76d-4777-b168-b64966959e6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:02.866207 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c20c2254-a76d-4777-b168-b64966959e6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.150362 Jul 21 17:37:02.866798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 136/261] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:03.083031 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d0777df8-32fc-4c0a-be84-21c201f1f0c9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:03.083573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d0777df8-32fc-4c0a-be84-21c201f1f0c9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:03.091216 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d0777df8-32fc-4c0a-be84-21c201f1f0c9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:03.091650 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d0777df8-32fc-4c0a-be84-21c201f1f0c9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:03.092458 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d0777df8-32fc-4c0a-be84-21c201f1f0c9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:03.092942 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d0777df8-32fc-4c0a-be84-21c201f1f0c9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:03.224642 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d0777df8-32fc-4c0a-be84-21c201f1f0c9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:03.232102 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d0777df8-32fc-4c0a-be84-21c201f1f0c9 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1510 microversion: 2.1 time: 0.152989 Jul 21 17:37:03.232716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 126/262] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:03 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:03.885002 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bd148568-895b-4651-ae4f-4c4ecc7c3631 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:03.885826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bd148568-895b-4651-ae4f-4c4ecc7c3631 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:03.892348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bd148568-895b-4651-ae4f-4c4ecc7c3631 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:03.892810 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bd148568-895b-4651-ae4f-4c4ecc7c3631 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:03.893583 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bd148568-895b-4651-ae4f-4c4ecc7c3631 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:03.894029 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bd148568-895b-4651-ae4f-4c4ecc7c3631 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:04.028189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-bd148568-895b-4651-ae4f-4c4ecc7c3631 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:04.036922 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bd148568-895b-4651-ae4f-4c4ecc7c3631 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.156440 Jul 21 17:37:04.037490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 137/263] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:03 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:04.250220 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-81ecb1e9-12d9-4a46-99f4-e4473445d7b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:04.250753 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-81ecb1e9-12d9-4a46-99f4-e4473445d7b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:04.257199 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81ecb1e9-12d9-4a46-99f4-e4473445d7b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:04.257657 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81ecb1e9-12d9-4a46-99f4-e4473445d7b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:04.258425 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81ecb1e9-12d9-4a46-99f4-e4473445d7b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:04.258868 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81ecb1e9-12d9-4a46-99f4-e4473445d7b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:04.387491 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-81ecb1e9-12d9-4a46-99f4-e4473445d7b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:04.394948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-81ecb1e9-12d9-4a46-99f4-e4473445d7b4 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1516 microversion: 2.1 time: 0.148705 Jul 21 17:37:04.395527 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 127/264] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:04 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:05.054518 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f48f26f3-820e-4239-84b2-f04c7f20aa0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:05.055138 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f48f26f3-820e-4239-84b2-f04c7f20aa0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:05.062191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f48f26f3-820e-4239-84b2-f04c7f20aa0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:05.062644 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f48f26f3-820e-4239-84b2-f04c7f20aa0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:05.063420 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f48f26f3-820e-4239-84b2-f04c7f20aa0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:05.063859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f48f26f3-820e-4239-84b2-f04c7f20aa0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:05.198379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f48f26f3-820e-4239-84b2-f04c7f20aa0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:05.206316 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f48f26f3-820e-4239-84b2-f04c7f20aa0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.155638 Jul 21 17:37:05.206892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 138/265] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:06.223587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-698a8e5f-54a5-4fbb-be61-47ab2722fc36 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:06.224202 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-698a8e5f-54a5-4fbb-be61-47ab2722fc36 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:06.230808 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-698a8e5f-54a5-4fbb-be61-47ab2722fc36 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:06.231270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-698a8e5f-54a5-4fbb-be61-47ab2722fc36 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:06.232044 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-698a8e5f-54a5-4fbb-be61-47ab2722fc36 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:06.232517 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-698a8e5f-54a5-4fbb-be61-47ab2722fc36 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:06.362447 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-698a8e5f-54a5-4fbb-be61-47ab2722fc36 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:06.371040 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-698a8e5f-54a5-4fbb-be61-47ab2722fc36 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.151310 Jul 21 17:37:06.371613 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 128/266] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:06 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:07.388464 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7f816bdc-e28d-4fba-b72a-06adac0125a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:07.389073 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7f816bdc-e28d-4fba-b72a-06adac0125a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:07.395506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7f816bdc-e28d-4fba-b72a-06adac0125a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:07.395957 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7f816bdc-e28d-4fba-b72a-06adac0125a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:07.396759 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7f816bdc-e28d-4fba-b72a-06adac0125a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:07.397203 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7f816bdc-e28d-4fba-b72a-06adac0125a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:07.527651 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7f816bdc-e28d-4fba-b72a-06adac0125a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:07.535520 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7f816bdc-e28d-4fba-b72a-06adac0125a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.151190 Jul 21 17:37:07.536084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 139/267] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:07 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:08.553718 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-390cf5b2-74dc-4a1c-9209-fc52cea8be85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:08.554246 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-390cf5b2-74dc-4a1c-9209-fc52cea8be85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:08.561378 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-390cf5b2-74dc-4a1c-9209-fc52cea8be85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:08.561827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-390cf5b2-74dc-4a1c-9209-fc52cea8be85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:08.562588 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-390cf5b2-74dc-4a1c-9209-fc52cea8be85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:08.563023 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-390cf5b2-74dc-4a1c-9209-fc52cea8be85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:08.691932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-390cf5b2-74dc-4a1c-9209-fc52cea8be85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:08.700051 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-390cf5b2-74dc-4a1c-9209-fc52cea8be85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.150253 Jul 21 17:37:08.700644 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 129/268] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:09.717682 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d638c8c7-019f-4b0f-b7c5-f18a26e82266 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:09.718466 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d638c8c7-019f-4b0f-b7c5-f18a26e82266 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:09.720975 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=36 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:37:09.726463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d638c8c7-019f-4b0f-b7c5-f18a26e82266 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:09.726922 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d638c8c7-019f-4b0f-b7c5-f18a26e82266 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:09.728484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d638c8c7-019f-4b0f-b7c5-f18a26e82266 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:09.728947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d638c8c7-019f-4b0f-b7c5-f18a26e82266 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:09.856821 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d638c8c7-019f-4b0f-b7c5-f18a26e82266 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:09.864734 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d638c8c7-019f-4b0f-b7c5-f18a26e82266 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.150948 Jul 21 17:37:09.865300 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 140/269] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:10.881019 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-37fc60da-3d8e-4144-af6c-2528a42a3fc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:10.881656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-37fc60da-3d8e-4144-af6c-2528a42a3fc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:10.884085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=36 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:37:10.889631 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-37fc60da-3d8e-4144-af6c-2528a42a3fc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:10.890092 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-37fc60da-3d8e-4144-af6c-2528a42a3fc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:10.890871 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-37fc60da-3d8e-4144-af6c-2528a42a3fc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:10.891318 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-37fc60da-3d8e-4144-af6c-2528a42a3fc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:11.025015 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-37fc60da-3d8e-4144-af6c-2528a42a3fc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:11.033048 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-37fc60da-3d8e-4144-af6c-2528a42a3fc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.155828 Jul 21 17:37:11.033625 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 130/270] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:10 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:37:12.049945 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a21e5d51-35b0-4bc4-bd70-7770e6224e33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:12.050506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a21e5d51-35b0-4bc4-bd70-7770e6224e33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:12.057685 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a21e5d51-35b0-4bc4-bd70-7770e6224e33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:12.058135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a21e5d51-35b0-4bc4-bd70-7770e6224e33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:12.058903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a21e5d51-35b0-4bc4-bd70-7770e6224e33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:12.059346 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a21e5d51-35b0-4bc4-bd70-7770e6224e33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:12.190065 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a21e5d51-35b0-4bc4-bd70-7770e6224e33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:12.198924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a21e5d51-35b0-4bc4-bd70-7770e6224e33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.152871 Jul 21 17:37:12.199725 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 141/271] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:12 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:13.215652 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-da4db988-c04e-4377-bf67-560730e74d0d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:13.216276 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-da4db988-c04e-4377-bf67-560730e74d0d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:13.225418 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da4db988-c04e-4377-bf67-560730e74d0d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:13.225882 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da4db988-c04e-4377-bf67-560730e74d0d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:13.226668 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da4db988-c04e-4377-bf67-560730e74d0d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:13.227115 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da4db988-c04e-4377-bf67-560730e74d0d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:13.362573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-da4db988-c04e-4377-bf67-560730e74d0d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:13.371091 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-da4db988-c04e-4377-bf67-560730e74d0d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1724 microversion: 2.1 time: 0.159992 Jul 21 17:37:13.371654 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 131/272] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:14.387365 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-12eb8b2a-c336-429e-8cb4-f8d636ad5790 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:14.387975 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-12eb8b2a-c336-429e-8cb4-f8d636ad5790 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:14.394502 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12eb8b2a-c336-429e-8cb4-f8d636ad5790 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:14.394948 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12eb8b2a-c336-429e-8cb4-f8d636ad5790 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:14.395706 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12eb8b2a-c336-429e-8cb4-f8d636ad5790 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:14.396142 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12eb8b2a-c336-429e-8cb4-f8d636ad5790 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:14.523052 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-12eb8b2a-c336-429e-8cb4-f8d636ad5790 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:14.532480 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-12eb8b2a-c336-429e-8cb4-f8d636ad5790 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1701 microversion: 2.1 time: 0.149042 Jul 21 17:37:14.533057 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 142/273] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:14 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1701 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:14.548861 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-86897a46-3a4e-4db5-ae76-f497576b92fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:37:14.555337 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86897a46-3a4e-4db5-ae76-f497576b92fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:14.555792 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86897a46-3a4e-4db5-ae76-f497576b92fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:14.616899 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-86897a46-3a4e-4db5-ae76-f497576b92fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Going to try to start instance {{(pid=124380) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 17:37:14.658907 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-86897a46-3a4e-4db5-ae76-f497576b92fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "POST /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/action" status: 202 len: 0 microversion: 2.1 time: 0.113793 Jul 21 17:37:14.659669 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 132/274] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 17:37:14 2022] POST /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 17:37:14.667858 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2c6987a0-6b36-4928-b19f-5a0759eff0f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:14.668514 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2c6987a0-6b36-4928-b19f-5a0759eff0f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:14.674507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c6987a0-6b36-4928-b19f-5a0759eff0f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:14.674961 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c6987a0-6b36-4928-b19f-5a0759eff0f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:14.675787 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c6987a0-6b36-4928-b19f-5a0759eff0f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:14.676177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c6987a0-6b36-4928-b19f-5a0759eff0f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:14.823430 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2c6987a0-6b36-4928-b19f-5a0759eff0f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:14.831604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2c6987a0-6b36-4928-b19f-5a0759eff0f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1710 microversion: 2.1 time: 0.167784 Jul 21 17:37:14.832174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 143/275] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:14 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1710 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:15.850810 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c8155917-99f2-46a2-a4b6-fdd48e3b4354 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:15.851430 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c8155917-99f2-46a2-a4b6-fdd48e3b4354 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:15.857730 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c8155917-99f2-46a2-a4b6-fdd48e3b4354 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:15.858181 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c8155917-99f2-46a2-a4b6-fdd48e3b4354 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:15.858938 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c8155917-99f2-46a2-a4b6-fdd48e3b4354 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:15.859369 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c8155917-99f2-46a2-a4b6-fdd48e3b4354 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:15.999356 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c8155917-99f2-46a2-a4b6-fdd48e3b4354 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:16.007324 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c8155917-99f2-46a2-a4b6-fdd48e3b4354 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1710 microversion: 2.1 time: 0.161192 Jul 21 17:37:16.007888 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 133/276] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:17.026335 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-393e740b-8088-49bb-a4d1-7ef6fcf96fa5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:17.026943 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-393e740b-8088-49bb-a4d1-7ef6fcf96fa5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:17.033053 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-393e740b-8088-49bb-a4d1-7ef6fcf96fa5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:17.033502 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-393e740b-8088-49bb-a4d1-7ef6fcf96fa5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:17.034266 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-393e740b-8088-49bb-a4d1-7ef6fcf96fa5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:17.034701 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-393e740b-8088-49bb-a4d1-7ef6fcf96fa5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:17.163072 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-393e740b-8088-49bb-a4d1-7ef6fcf96fa5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:37:17.171617 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-393e740b-8088-49bb-a4d1-7ef6fcf96fa5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1714 microversion: 2.1 time: 0.150552 Jul 21 17:37:17.172177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 144/277] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:37:17 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:37:50.255230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ef65d486-8c7a-4809-905c-762c7ecff48b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:37:50.255798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ef65d486-8c7a-4809-905c-762c7ecff48b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:37:50.257934 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=7 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:37:50.258719 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:37:50.264188 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef65d486-8c7a-4809-905c-762c7ecff48b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:50.264665 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef65d486-8c7a-4809-905c-762c7ecff48b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:50.265435 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef65d486-8c7a-4809-905c-762c7ecff48b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:37:50.265880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef65d486-8c7a-4809-905c-762c7ecff48b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:37:50.420467 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-ef65d486-8c7a-4809-905c-762c7ecff48b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lazy-loading 'services' on Instance uuid 9ff28a98-a8bf-43c7-ad64-2b693c0d419e {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 17:37:50.532169 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ef65d486-8c7a-4809-905c-762c7ecff48b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments/9895b125-ae13-4a2b-9454-8649790b38ad" status: 202 len: 0 microversion: 2.1 time: 0.280869 Jul 21 17:37:50.532806 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 134/278] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 17:37:50 2022] DELETE /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments/9895b125-ae13-4a2b-9454-8649790b38ad => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 17:39:05.821773 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:39:05.822469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 17:39:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:39:13.881759 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:39:13.882242 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 17:39:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:39:18.014261 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:39:18.014670 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 17:39:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:39:18.049526 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:39:18.049995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 17:39:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:39:31.544731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:39:31.545365 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 17:39:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:41:59.195030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b71c6463-130e-4aa5-9606-3f6bbe5d89f7] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 21 17:41:59.195647 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=9 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:41:59.196466 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:41:59.201224 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-10c4dfbe-bc75-46f3-968f-b426bab97dc0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:41:59.201721 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-10c4dfbe-bc75-46f3-968f-b426bab97dc0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:41:59.210244 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-10c4dfbe-bc75-46f3-968f-b426bab97dc0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:41:59.210652 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-10c4dfbe-bc75-46f3-968f-b426bab97dc0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:41:59.211452 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-10c4dfbe-bc75-46f3-968f-b426bab97dc0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:41:59.211893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-10c4dfbe-bc75-46f3-968f-b426bab97dc0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:41:59.238258 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-10c4dfbe-bc75-46f3-968f-b426bab97dc0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Going to try to terminate instance {{(pid=124381) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 17:41:59.327083 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-10c4dfbe-bc75-46f3-968f-b426bab97dc0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 204 len: 0 microversion: 2.1 time: 0.133885 Jul 21 17:41:59.327758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 145/279] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 17:41:59 2022] DELETE /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 17:41:59.333920 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [-] [769f48e3-05be-4b42-ac4d-f350afc85548] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 17:41:59.334491 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:41:59.335242 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:41:59.339677 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-227388c3-d2d8-4d4f-bb11-419c862d6343 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:41:59.341041 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-227388c3-d2d8-4d4f-bb11-419c862d6343 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:41:59.349363 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-227388c3-d2d8-4d4f-bb11-419c862d6343 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:41:59.349817 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-227388c3-d2d8-4d4f-bb11-419c862d6343 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:41:59.350697 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-227388c3-d2d8-4d4f-bb11-419c862d6343 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:41:59.351138 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-227388c3-d2d8-4d4f-bb11-419c862d6343 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:41:59.658868 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-227388c3-d2d8-4d4f-bb11-419c862d6343 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:41:59.666443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-227388c3-d2d8-4d4f-bb11-419c862d6343 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1682 microversion: 2.1 time: 0.334248 Jul 21 17:41:59.667003 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 135/280] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:41:59 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1682 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:00.684651 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5db6c96e-accf-435a-a8a1-7b0e45c32d6b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:00.685355 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5db6c96e-accf-435a-a8a1-7b0e45c32d6b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:00.694223 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5db6c96e-accf-435a-a8a1-7b0e45c32d6b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:00.694946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5db6c96e-accf-435a-a8a1-7b0e45c32d6b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:00.695903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5db6c96e-accf-435a-a8a1-7b0e45c32d6b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:00.696527 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5db6c96e-accf-435a-a8a1-7b0e45c32d6b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:00.703297 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] [b71c6463-130e-4aa5-9606-3f6bbe5d89f7] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 33468. Jul 21 17:42:00.841481 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] [769f48e3-05be-4b42-ac4d-f350afc85548] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 33476. Jul 21 17:42:00.847503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5db6c96e-accf-435a-a8a1-7b0e45c32d6b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:42:00.858692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5db6c96e-accf-435a-a8a1-7b0e45c32d6b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 200 len: 1615 microversion: 2.1 time: 0.178281 Jul 21 17:42:00.860418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 146/281] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:00 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 1615 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:00.902700 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-d3d02480-01af-4ee1-85b2-e35cf27e0e5a req-5ce4faaa-fb2d-4a4e-9f88-e8e94b93d7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da2560b-0f95-4dac-9745-d34cecc16575", "name": "network-vif-deleted", "tag": "83ce89a6-6dd2-4dd5-abf5-d6c811684318"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:42:00.911466 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-d3d02480-01af-4ee1-85b2-e35cf27e0e5a req-5ce4faaa-fb2d-4a4e-9f88-e8e94b93d7ee service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:00.911915 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-d3d02480-01af-4ee1-85b2-e35cf27e0e5a req-5ce4faaa-fb2d-4a4e-9f88-e8e94b93d7ee service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:00.931717 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-d3d02480-01af-4ee1-85b2-e35cf27e0e5a req-5ce4faaa-fb2d-4a4e-9f88-e8e94b93d7ee service nova] Creating event network-vif-deleted:83ce89a6-6dd2-4dd5-abf5-d6c811684318 for instance 2da2560b-0f95-4dac-9745-d34cecc16575 on hv-cinder-82549 Jul 21 17:42:00.936032 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [req-d3d02480-01af-4ee1-85b2-e35cf27e0e5a req-5ce4faaa-fb2d-4a4e-9f88-e8e94b93d7ee service nova] [3cabb5b5-9136-4aa2-b570-e48b07ce9389] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 17:42:01.875517 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-be46664e-5c87-4bb0-9766-4854a24222b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:01.876136 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-be46664e-5c87-4bb0-9766-4854a24222b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:01.883351 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-be46664e-5c87-4bb0-9766-4854a24222b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:01.883809 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-be46664e-5c87-4bb0-9766-4854a24222b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:01.884823 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-be46664e-5c87-4bb0-9766-4854a24222b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:01.885287 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-be46664e-5c87-4bb0-9766-4854a24222b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:01.899611 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-be46664e-5c87-4bb0-9766-4854a24222b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] HTTP exception thrown: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-be46664e-5c87-4bb0-9766-4854a24222b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Request method failure captured: Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 HTTP/1.1 Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Y4MLMBby9pVb6fwZuBjDRRu9HKRFu1ubjEDLV-WnX1WKQKVX_XMZ4Yqw6FkUH0RRqITWcDICF4pmsesAnL59Rfd9lRL-u5FtRZh9LwiE1kZl5RReoX0EElUgVwXfWiOqjbNCaVPpfluVfKkWpY7Bs2i6epWgLEEnsNP5LGqfJDuT0g Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 17:42:01.901426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 17:42:01.907491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0917b2a75df4a9ab1d2cbd4fd3f7613", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}] Jul 21 17:42:01.907491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 17:42:01.907491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 17:42:01.907491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 17:42:01.907491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 17:42:01.907491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 17:42:01.907491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 17:42:01.907491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: fa82bddf9aa0455797d42993fe850ccf Jul 21 17:42:01.907491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 17:42:01.907491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 17:42:01.907491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 17:42:01.907491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '2da2560b-0f95-4dac-9745-d34cecc16575'} Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:42:01.908504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 17:42:01.909976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:42:01.911279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-be46664e-5c87-4bb0-9766-4854a24222b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Returning 404 to user: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:42:01.911279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-be46664e-5c87-4bb0-9766-4854a24222b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 404 len: 111 microversion: 2.1 time: 0.031730 Jul 21 17:42:01.911279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 147/282] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:01 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 17:42:01.912101 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3520885d-7dfe-44d8-ad59-ab52d568d505 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '.version_select at 0x7ffa2ccdaee0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:01.943649 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3520885d-7dfe-44d8-ad59-ab52d568d505 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2028519348" status: 202 len: 0 microversion: 2.1 time: 0.034985 Jul 21 17:42:01.944719 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 148/283] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jul 21 17:42:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2028519348 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 17:42:01.948936 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [req-d3d02480-01af-4ee1-85b2-e35cf27e0e5a req-5ce4faaa-fb2d-4a4e-9f88-e8e94b93d7ee service nova] [3cabb5b5-9136-4aa2-b570-e48b07ce9389] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 33492. Jul 21 17:42:01.954119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-d3d02480-01af-4ee1-85b2-e35cf27e0e5a req-5ce4faaa-fb2d-4a4e-9f88-e8e94b93d7ee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.139290 Jul 21 17:42:01.955154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 136/284] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:42:02.758312 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-453e426a-94cc-4c97-90fb-bc8b5eba3714 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Action: 'create', calling method: .version_select at 0x7ffa2a5e8dc0>, body: {"keypair": {"name": "tempest-keypair-1272564138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1Rhr5fxabEpIxwbTvcRxlEaoWWT9ws9Fc3JoJ22CUAQeTlp2YQ7oYKb4o26ShFiGay6Pl7Rq7Az/0ayevW0SRbOHf+7AEn3lrInu9EsCuymNhbAU8tKou8Cf329l38Sw=="}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:42:02.775358 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-453e426a-94cc-4c97-90fb-bc8b5eba3714 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Getting quotas for project b0917b2a75df4a9ab1d2cbd4fd3f7613. Resources: {'key_pairs'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:42:02.780801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-453e426a-94cc-4c97-90fb-bc8b5eba3714 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Getting quotas for user fa82bddf9aa0455797d42993fe850ccf and project b0917b2a75df4a9ab1d2cbd4fd3f7613. Resources: {'key_pairs'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:42:02.823576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-453e426a-94cc-4c97-90fb-bc8b5eba3714 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059222 Jul 21 17:42:02.823576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 149/285] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 17:42:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:42:04.651017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-49109888", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06d00d4d-9cae-405b-a67d-dc9e38e8701d"}], "security_groups": [{"name": "tempest-securitygroup--689583550"}], "key_name": "tempest-keypair-1272564138", "user_data": "}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:42:04.754679 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] validate_networks() for [('06d00d4d-9cae-405b-a67d-dc9e38e8701d', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 17:42:05.164219 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 17:42:05.164686 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 17:42:05.165165 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 17:42:05.165581 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 17:42:05.166000 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 17:42:05.175007 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:05.175465 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:05.176270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:05.176744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:05.194104 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Getting quotas for project b0917b2a75df4a9ab1d2cbd4fd3f7613. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:42:05.197989 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Getting quotas for user fa82bddf9aa0455797d42993fe850ccf and project b0917b2a75df4a9ab1d2cbd4fd3f7613. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:42:05.209436 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 17:42:05.211744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 17:42:05.261256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-70acf32c-5d53-4f75-8c42-5f5b6ac2dcce tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.615211 Jul 21 17:42:05.263090 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 137/286] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 17:42:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 17:42:05.273003 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4269dea6-3512-4689-bd82-b3008b6147aa tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:05.273771 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4269dea6-3512-4689-bd82-b3008b6147aa tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:05.334753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4269dea6-3512-4689-bd82-b3008b6147aa tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:42:05.342191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4269dea6-3512-4689-bd82-b3008b6147aa tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1240 microversion: 2.1 time: 0.073439 Jul 21 17:42:05.342683 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 150/287] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:05 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:06.360197 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-45c1f425-689c-4a92-aad5-91e2414ebab8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:06.361126 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-45c1f425-689c-4a92-aad5-91e2414ebab8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:06.368006 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-45c1f425-689c-4a92-aad5-91e2414ebab8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:06.368753 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-45c1f425-689c-4a92-aad5-91e2414ebab8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:06.369640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-45c1f425-689c-4a92-aad5-91e2414ebab8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:06.370237 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-45c1f425-689c-4a92-aad5-91e2414ebab8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:06.449059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-45c1f425-689c-4a92-aad5-91e2414ebab8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:42:06.457277 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-45c1f425-689c-4a92-aad5-91e2414ebab8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1310 microversion: 2.1 time: 0.102186 Jul 21 17:42:06.457867 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 138/288] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:06 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1310 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:07.475499 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-da0a1466-9ced-477f-917a-b5ed2e516e60 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:07.476044 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-da0a1466-9ced-477f-917a-b5ed2e516e60 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:07.483327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-da0a1466-9ced-477f-917a-b5ed2e516e60 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:07.483776 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-da0a1466-9ced-477f-917a-b5ed2e516e60 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:07.484583 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-da0a1466-9ced-477f-917a-b5ed2e516e60 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:07.485023 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-da0a1466-9ced-477f-917a-b5ed2e516e60 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:07.678074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-da0a1466-9ced-477f-917a-b5ed2e516e60 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:42:07.686839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-da0a1466-9ced-477f-917a-b5ed2e516e60 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1365 microversion: 2.1 time: 0.215288 Jul 21 17:42:07.687412 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 151/289] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:07 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:07.912092 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-432796f1-b827-4f72-958b-c284aa8ac206 req-9e74f541-979a-4f34-ad46-545f689f6a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7", "tag": "dc97e3c9-88da-4cd5-883f-01b8f4999c6d"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:42:07.924245 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-432796f1-b827-4f72-958b-c284aa8ac206 req-9e74f541-979a-4f34-ad46-545f689f6a30 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:07.925076 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-432796f1-b827-4f72-958b-c284aa8ac206 req-9e74f541-979a-4f34-ad46-545f689f6a30 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:07.950755 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-432796f1-b827-4f72-958b-c284aa8ac206 req-9e74f541-979a-4f34-ad46-545f689f6a30 service nova] Creating event network-changed:dc97e3c9-88da-4cd5-883f-01b8f4999c6d for instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 on hv-cinder-82549 Jul 21 17:42:07.956212 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-432796f1-b827-4f72-958b-c284aa8ac206 req-9e74f541-979a-4f34-ad46-545f689f6a30 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047960 Jul 21 17:42:07.956853 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 139/290] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:42:08.704312 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0e3b10f1-528d-4d77-872d-c3bc000fba11 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:08.704951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0e3b10f1-528d-4d77-872d-c3bc000fba11 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:08.711792 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0e3b10f1-528d-4d77-872d-c3bc000fba11 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:08.712252 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0e3b10f1-528d-4d77-872d-c3bc000fba11 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:08.713236 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0e3b10f1-528d-4d77-872d-c3bc000fba11 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:08.713839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0e3b10f1-528d-4d77-872d-c3bc000fba11 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:08.736924 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7326bc17-31b7-47fe-a854-d2a5a708b7a5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:08.737509 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7326bc17-31b7-47fe-a854-d2a5a708b7a5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:08.743768 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7326bc17-31b7-47fe-a854-d2a5a708b7a5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:08.744184 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7326bc17-31b7-47fe-a854-d2a5a708b7a5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:08.745004 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7326bc17-31b7-47fe-a854-d2a5a708b7a5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:08.745444 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7326bc17-31b7-47fe-a854-d2a5a708b7a5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:08.829000 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-7326bc17-31b7-47fe-a854-d2a5a708b7a5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lazy-loading 'services' on Instance uuid e14c1a66-269c-4e3f-95f6-6388fe5c16c1 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 17:42:08.867610 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0e3b10f1-528d-4d77-872d-c3bc000fba11 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:42:08.877449 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0e3b10f1-528d-4d77-872d-c3bc000fba11 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1365 microversion: 2.1 time: 0.176463 Jul 21 17:42:08.879131 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 152/291] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:08 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:08.906961 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7326bc17-31b7-47fe-a854-d2a5a708b7a5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1/os-volume_attachments/3f357372-21f9-454e-aa51-d43841c91883" status: 202 len: 0 microversion: 2.1 time: 0.174078 Jul 21 17:42:08.907562 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 140/292] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 17:42:08 2022] DELETE /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1/os-volume_attachments/3f357372-21f9-454e-aa51-d43841c91883 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 17:42:09.895329 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f540673e-c1bf-47dd-bc37-ffe381ba517d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:09.895868 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f540673e-c1bf-47dd-bc37-ffe381ba517d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:09.902423 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f540673e-c1bf-47dd-bc37-ffe381ba517d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:09.902876 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f540673e-c1bf-47dd-bc37-ffe381ba517d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:09.903947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f540673e-c1bf-47dd-bc37-ffe381ba517d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:09.904418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f540673e-c1bf-47dd-bc37-ffe381ba517d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:10.066129 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f540673e-c1bf-47dd-bc37-ffe381ba517d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:42:10.073841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f540673e-c1bf-47dd-bc37-ffe381ba517d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1365 microversion: 2.1 time: 0.182473 Jul 21 17:42:10.074488 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 153/293] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:09 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:11.095311 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0de8c2ac-672d-47d9-8e43-47b996f8368a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:11.096153 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0de8c2ac-672d-47d9-8e43-47b996f8368a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:11.102959 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0de8c2ac-672d-47d9-8e43-47b996f8368a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:11.103401 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0de8c2ac-672d-47d9-8e43-47b996f8368a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:11.104180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0de8c2ac-672d-47d9-8e43-47b996f8368a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:11.104648 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0de8c2ac-672d-47d9-8e43-47b996f8368a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:11.241887 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0de8c2ac-672d-47d9-8e43-47b996f8368a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:42:11.250351 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0de8c2ac-672d-47d9-8e43-47b996f8368a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1365 microversion: 2.1 time: 0.162652 Jul 21 17:42:11.250904 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 141/294] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:11 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:12.267541 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3e05f862-6849-488e-a46c-2dff65b7b086 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:12.268356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3e05f862-6849-488e-a46c-2dff65b7b086 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:12.274933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3e05f862-6849-488e-a46c-2dff65b7b086 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:12.275405 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3e05f862-6849-488e-a46c-2dff65b7b086 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:12.276163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3e05f862-6849-488e-a46c-2dff65b7b086 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:12.276656 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3e05f862-6849-488e-a46c-2dff65b7b086 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:12.412774 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3e05f862-6849-488e-a46c-2dff65b7b086 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:42:12.420778 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3e05f862-6849-488e-a46c-2dff65b7b086 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1365 microversion: 2.1 time: 0.157101 Jul 21 17:42:12.421347 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 154/295] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:12 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:13.437819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b114dde4-320c-418c-8414-2106a9b84af7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:13.438616 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b114dde4-320c-418c-8414-2106a9b84af7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:13.445453 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b114dde4-320c-418c-8414-2106a9b84af7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:13.445887 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b114dde4-320c-418c-8414-2106a9b84af7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:13.446664 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b114dde4-320c-418c-8414-2106a9b84af7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:13.447103 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b114dde4-320c-418c-8414-2106a9b84af7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:13.576263 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b114dde4-320c-418c-8414-2106a9b84af7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:42:13.583631 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b114dde4-320c-418c-8414-2106a9b84af7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1365 microversion: 2.1 time: 0.149935 Jul 21 17:42:13.584229 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 142/296] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:13 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:14.184891 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-1ae1fb68-2530-4c7a-ad2c-edfd69f92469 req-63779eba-dedb-4e53-a07d-ea3627721376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7", "name": "network-vif-plugged", "status": "completed", "tag": "dc97e3c9-88da-4cd5-883f-01b8f4999c6d"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:42:14.193322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-1ae1fb68-2530-4c7a-ad2c-edfd69f92469 req-63779eba-dedb-4e53-a07d-ea3627721376 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:14.193760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-1ae1fb68-2530-4c7a-ad2c-edfd69f92469 req-63779eba-dedb-4e53-a07d-ea3627721376 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:14.204393 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-1ae1fb68-2530-4c7a-ad2c-edfd69f92469 req-63779eba-dedb-4e53-a07d-ea3627721376 service nova] Creating event network-vif-plugged:dc97e3c9-88da-4cd5-883f-01b8f4999c6d for instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 on hv-cinder-82549 Jul 21 17:42:14.209511 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-1ae1fb68-2530-4c7a-ad2c-edfd69f92469 req-63779eba-dedb-4e53-a07d-ea3627721376 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154425 Jul 21 17:42:14.210095 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 155/297] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:42:14.600633 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a406af71-9aa8-467d-9fff-b8a7945bf520 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:14.601257 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a406af71-9aa8-467d-9fff-b8a7945bf520 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:14.609021 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a406af71-9aa8-467d-9fff-b8a7945bf520 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:14.609483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a406af71-9aa8-467d-9fff-b8a7945bf520 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:14.610278 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a406af71-9aa8-467d-9fff-b8a7945bf520 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:14.610722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a406af71-9aa8-467d-9fff-b8a7945bf520 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:14.745981 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a406af71-9aa8-467d-9fff-b8a7945bf520 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:42:14.754011 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a406af71-9aa8-467d-9fff-b8a7945bf520 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1365 microversion: 2.1 time: 0.157220 Jul 21 17:42:14.754592 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 143/298] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:14 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:15.769394 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=6 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:42:15.774268 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1b1ba147-dab7-4db9-8e93-c36a261a2b7b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:15.774965 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1b1ba147-dab7-4db9-8e93-c36a261a2b7b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:15.781804 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1b1ba147-dab7-4db9-8e93-c36a261a2b7b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:15.782246 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1b1ba147-dab7-4db9-8e93-c36a261a2b7b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:15.783014 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1b1ba147-dab7-4db9-8e93-c36a261a2b7b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:15.783454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1b1ba147-dab7-4db9-8e93-c36a261a2b7b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:15.917686 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1b1ba147-dab7-4db9-8e93-c36a261a2b7b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:42:15.924192 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1b1ba147-dab7-4db9-8e93-c36a261a2b7b tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1365 microversion: 2.1 time: 0.156381 Jul 21 17:42:15.924806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 156/299] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:15 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:16.941010 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c1c3351e-84b2-421b-bccf-85a488bea8d7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:16.941714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c1c3351e-84b2-421b-bccf-85a488bea8d7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:16.943756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:42:16.944597 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:42:16.951783 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1c3351e-84b2-421b-bccf-85a488bea8d7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:16.952216 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1c3351e-84b2-421b-bccf-85a488bea8d7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:16.953017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1c3351e-84b2-421b-bccf-85a488bea8d7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:16.953452 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1c3351e-84b2-421b-bccf-85a488bea8d7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:17.107085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c1c3351e-84b2-421b-bccf-85a488bea8d7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:42:17.118416 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c1c3351e-84b2-421b-bccf-85a488bea8d7 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1555 microversion: 2.1 time: 0.181475 Jul 21 17:42:17.118994 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 144/300] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:42:16 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:42:17.136085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3f3f15ec-a4d8-458e-9946-63ad559c55a1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:17.136658 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3f3f15ec-a4d8-458e-9946-63ad559c55a1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:17.143648 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f3f15ec-a4d8-458e-9946-63ad559c55a1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:17.144092 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f3f15ec-a4d8-458e-9946-63ad559c55a1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:17.144933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f3f15ec-a4d8-458e-9946-63ad559c55a1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:17.145375 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f3f15ec-a4d8-458e-9946-63ad559c55a1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:17.228964 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3f3f15ec-a4d8-458e-9946-63ad559c55a1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096935 Jul 21 17:42:17.229739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 157/301] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 17:42:17 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:42:18.276017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-ef67d3a5-21a2-482d-b4e1-bd39bd5912dd req-c39e014d-28f6-40b0-9888-773528b3a7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7", "tag": "dc97e3c9-88da-4cd5-883f-01b8f4999c6d"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:42:18.284831 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-ef67d3a5-21a2-482d-b4e1-bd39bd5912dd req-c39e014d-28f6-40b0-9888-773528b3a7e5 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:18.285498 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-ef67d3a5-21a2-482d-b4e1-bd39bd5912dd req-c39e014d-28f6-40b0-9888-773528b3a7e5 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:18.297702 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-ef67d3a5-21a2-482d-b4e1-bd39bd5912dd req-c39e014d-28f6-40b0-9888-773528b3a7e5 service nova] Creating event network-changed:dc97e3c9-88da-4cd5-883f-01b8f4999c6d for instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 on hv-cinder-82549 Jul 21 17:42:18.302805 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-ef67d3a5-21a2-482d-b4e1-bd39bd5912dd req-c39e014d-28f6-40b0-9888-773528b3a7e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095837 Jul 21 17:42:18.303535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 145/302] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:42:53.225185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:42:53.225958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:42:53.230148 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-31ff55b6-40a7-4a2e-a641-01d7e284a135 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:42:53.230719 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-31ff55b6-40a7-4a2e-a641-01d7e284a135 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:42:53.239418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-31ff55b6-40a7-4a2e-a641-01d7e284a135 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:53.239871 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-31ff55b6-40a7-4a2e-a641-01d7e284a135 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:53.240746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-31ff55b6-40a7-4a2e-a641-01d7e284a135 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:42:53.241191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-31ff55b6-40a7-4a2e-a641-01d7e284a135 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:42:53.267351 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-31ff55b6-40a7-4a2e-a641-01d7e284a135 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7/ips" status: 200 len: 149 microversion: 2.1 time: 0.043594 Jul 21 17:42:53.271136 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 158/303] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 17:42:53 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:43:50.857165 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:43:50.858391 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:43:50.866102 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-df131e0b-c86e-4913-a69d-13cdcd0987cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:43:50.867123 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-df131e0b-c86e-4913-a69d-13cdcd0987cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:43:50.875742 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df131e0b-c86e-4913-a69d-13cdcd0987cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:50.876200 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df131e0b-c86e-4913-a69d-13cdcd0987cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:50.877640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df131e0b-c86e-4913-a69d-13cdcd0987cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:50.878085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df131e0b-c86e-4913-a69d-13cdcd0987cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:50.907700 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-df131e0b-c86e-4913-a69d-13cdcd0987cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054143 Jul 21 17:43:50.908317 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 146/304] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:43:50 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:43:51.919862 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e35df131-68f6-4c6b-aaa0-4414f86364df tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:43:51.920882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e35df131-68f6-4c6b-aaa0-4414f86364df tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:43:51.923299 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=4 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:43:51.929300 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e35df131-68f6-4c6b-aaa0-4414f86364df tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:51.929786 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e35df131-68f6-4c6b-aaa0-4414f86364df tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:51.930608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e35df131-68f6-4c6b-aaa0-4414f86364df tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:51.931091 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e35df131-68f6-4c6b-aaa0-4414f86364df tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:51.962839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e35df131-68f6-4c6b-aaa0-4414f86364df tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047529 Jul 21 17:43:51.963447 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 159/305] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:43:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:43:52.975631 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fd28bd74-10e6-4db7-a4a7-cd83fda82fea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:43:52.976647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fd28bd74-10e6-4db7-a4a7-cd83fda82fea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:43:52.983121 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd28bd74-10e6-4db7-a4a7-cd83fda82fea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:52.983573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd28bd74-10e6-4db7-a4a7-cd83fda82fea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:52.984369 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd28bd74-10e6-4db7-a4a7-cd83fda82fea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:52.984813 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd28bd74-10e6-4db7-a4a7-cd83fda82fea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:53.012901 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fd28bd74-10e6-4db7-a4a7-cd83fda82fea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042132 Jul 21 17:43:53.013448 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 147/306] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:43:52 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:43:54.024123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9c753995-e060-41f2-8b4e-067a483d9ae6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:43:54.025054 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9c753995-e060-41f2-8b4e-067a483d9ae6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:43:54.032173 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9c753995-e060-41f2-8b4e-067a483d9ae6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:54.032650 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9c753995-e060-41f2-8b4e-067a483d9ae6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:54.033413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9c753995-e060-41f2-8b4e-067a483d9ae6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:54.033871 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9c753995-e060-41f2-8b4e-067a483d9ae6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:54.063038 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9c753995-e060-41f2-8b4e-067a483d9ae6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043139 Jul 21 17:43:54.063717 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 160/307] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:43:54 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:43:55.075255 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6fcfa827-6d92-450f-98f7-d35dc8dab4aa tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:43:55.076170 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6fcfa827-6d92-450f-98f7-d35dc8dab4aa tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:43:55.083270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6fcfa827-6d92-450f-98f7-d35dc8dab4aa tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:55.083719 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6fcfa827-6d92-450f-98f7-d35dc8dab4aa tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:55.084519 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6fcfa827-6d92-450f-98f7-d35dc8dab4aa tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:55.084961 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6fcfa827-6d92-450f-98f7-d35dc8dab4aa tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:55.113945 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6fcfa827-6d92-450f-98f7-d35dc8dab4aa tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042717 Jul 21 17:43:55.114494 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 148/308] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:43:55 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:43:56.125418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e5e0cb61-a13f-4642-a1fa-752b8bc9c1b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:43:56.126378 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e5e0cb61-a13f-4642-a1fa-752b8bc9c1b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:43:56.134243 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e5e0cb61-a13f-4642-a1fa-752b8bc9c1b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:56.134698 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e5e0cb61-a13f-4642-a1fa-752b8bc9c1b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:56.135478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e5e0cb61-a13f-4642-a1fa-752b8bc9c1b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:56.135919 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e5e0cb61-a13f-4642-a1fa-752b8bc9c1b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:56.168020 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e5e0cb61-a13f-4642-a1fa-752b8bc9c1b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046640 Jul 21 17:43:56.168643 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 161/309] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:43:56 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:43:57.179642 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-759278c8-24e3-4961-b8ed-f29201bafea5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:43:57.180598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-759278c8-24e3-4961-b8ed-f29201bafea5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:43:57.187368 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-759278c8-24e3-4961-b8ed-f29201bafea5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:57.187750 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-759278c8-24e3-4961-b8ed-f29201bafea5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:57.188558 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-759278c8-24e3-4961-b8ed-f29201bafea5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:57.189514 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-759278c8-24e3-4961-b8ed-f29201bafea5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:57.219823 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-759278c8-24e3-4961-b8ed-f29201bafea5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Jul 21 17:43:57.220419 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 149/310] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:43:57 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:43:58.231028 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2e419f58-c542-48c1-b9a0-2094062f0a93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:43:58.231974 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2e419f58-c542-48c1-b9a0-2094062f0a93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:43:58.238693 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e419f58-c542-48c1-b9a0-2094062f0a93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:58.239139 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e419f58-c542-48c1-b9a0-2094062f0a93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:58.239896 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e419f58-c542-48c1-b9a0-2094062f0a93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:58.240356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e419f58-c542-48c1-b9a0-2094062f0a93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:58.268740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2e419f58-c542-48c1-b9a0-2094062f0a93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 Jul 21 17:43:58.269280 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 162/311] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:43:58 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:43:59.280282 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-483e1d5b-7401-4522-acf1-cd2d152b7314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:43:59.281150 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-483e1d5b-7401-4522-acf1-cd2d152b7314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:43:59.287795 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-483e1d5b-7401-4522-acf1-cd2d152b7314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:59.288241 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-483e1d5b-7401-4522-acf1-cd2d152b7314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:59.289029 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-483e1d5b-7401-4522-acf1-cd2d152b7314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:43:59.289461 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-483e1d5b-7401-4522-acf1-cd2d152b7314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:43:59.319132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-483e1d5b-7401-4522-acf1-cd2d152b7314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042829 Jul 21 17:43:59.319682 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 150/312] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:43:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:00.331398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1c553308-1b18-42e1-92c5-1bb6d5feb2dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:00.332320 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1c553308-1b18-42e1-92c5-1bb6d5feb2dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:00.338718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1c553308-1b18-42e1-92c5-1bb6d5feb2dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:00.339194 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1c553308-1b18-42e1-92c5-1bb6d5feb2dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:00.339952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1c553308-1b18-42e1-92c5-1bb6d5feb2dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:00.340407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1c553308-1b18-42e1-92c5-1bb6d5feb2dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:00.367853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1c553308-1b18-42e1-92c5-1bb6d5feb2dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041059 Jul 21 17:44:00.368408 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 163/313] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:01.379437 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0e91224c-2d92-4f86-814c-246ee0d0fd58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:01.380413 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0e91224c-2d92-4f86-814c-246ee0d0fd58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:01.386650 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e91224c-2d92-4f86-814c-246ee0d0fd58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:01.387100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e91224c-2d92-4f86-814c-246ee0d0fd58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:01.387863 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e91224c-2d92-4f86-814c-246ee0d0fd58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:01.388320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e91224c-2d92-4f86-814c-246ee0d0fd58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:01.417311 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0e91224c-2d92-4f86-814c-246ee0d0fd58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Jul 21 17:44:01.417850 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 151/314] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:01 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:02.429464 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4bf6cfaf-a5d2-415a-a71c-790473045d52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:02.430378 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4bf6cfaf-a5d2-415a-a71c-790473045d52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:02.436752 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4bf6cfaf-a5d2-415a-a71c-790473045d52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:02.437194 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4bf6cfaf-a5d2-415a-a71c-790473045d52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:02.437946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4bf6cfaf-a5d2-415a-a71c-790473045d52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:02.438378 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4bf6cfaf-a5d2-415a-a71c-790473045d52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:02.466602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4bf6cfaf-a5d2-415a-a71c-790473045d52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041194 Jul 21 17:44:02.467133 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 164/315] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:03.478564 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-272f4c18-ed47-496a-b7ab-ec63e1f54a1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:03.479522 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-272f4c18-ed47-496a-b7ab-ec63e1f54a1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:03.486906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-272f4c18-ed47-496a-b7ab-ec63e1f54a1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:03.487359 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-272f4c18-ed47-496a-b7ab-ec63e1f54a1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:03.488124 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-272f4c18-ed47-496a-b7ab-ec63e1f54a1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:03.488597 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-272f4c18-ed47-496a-b7ab-ec63e1f54a1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:03.518043 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-272f4c18-ed47-496a-b7ab-ec63e1f54a1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043477 Jul 21 17:44:03.518580 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 152/316] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:03 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:04.529319 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-370e5dc0-45ac-4ccd-acec-8a22a4e80440 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:04.530179 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-370e5dc0-45ac-4ccd-acec-8a22a4e80440 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:04.537740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-370e5dc0-45ac-4ccd-acec-8a22a4e80440 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:04.538193 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-370e5dc0-45ac-4ccd-acec-8a22a4e80440 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:04.539060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-370e5dc0-45ac-4ccd-acec-8a22a4e80440 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:04.539502 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-370e5dc0-45ac-4ccd-acec-8a22a4e80440 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:04.570972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-370e5dc0-45ac-4ccd-acec-8a22a4e80440 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045534 Jul 21 17:44:04.571533 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 165/317] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:04 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:05.583388 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b0c6d154-2361-421a-abe3-51cdc0d5b4dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:05.584355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b0c6d154-2361-421a-abe3-51cdc0d5b4dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:05.591575 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0c6d154-2361-421a-abe3-51cdc0d5b4dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:05.592043 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0c6d154-2361-421a-abe3-51cdc0d5b4dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:05.592861 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0c6d154-2361-421a-abe3-51cdc0d5b4dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:05.593295 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0c6d154-2361-421a-abe3-51cdc0d5b4dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:05.626874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b0c6d154-2361-421a-abe3-51cdc0d5b4dc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047683 Jul 21 17:44:05.627477 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 153/318] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:05.829978 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:44:05.830278 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 17:44:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:44:06.638197 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-98a1c097-e14f-4b90-8c40-aaeb7ad0811f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:06.639114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-98a1c097-e14f-4b90-8c40-aaeb7ad0811f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:06.646315 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98a1c097-e14f-4b90-8c40-aaeb7ad0811f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:06.646761 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98a1c097-e14f-4b90-8c40-aaeb7ad0811f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:06.647545 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98a1c097-e14f-4b90-8c40-aaeb7ad0811f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:06.647958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98a1c097-e14f-4b90-8c40-aaeb7ad0811f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:06.676637 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-98a1c097-e14f-4b90-8c40-aaeb7ad0811f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Jul 21 17:44:06.677172 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 166/319] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:06 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:07.688230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bd1bcd94-a5fb-4073-a486-6f0871ae5973 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:07.689991 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bd1bcd94-a5fb-4073-a486-6f0871ae5973 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:07.696574 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bd1bcd94-a5fb-4073-a486-6f0871ae5973 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:07.697057 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bd1bcd94-a5fb-4073-a486-6f0871ae5973 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:07.697918 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bd1bcd94-a5fb-4073-a486-6f0871ae5973 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:07.698518 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bd1bcd94-a5fb-4073-a486-6f0871ae5973 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:07.728130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bd1bcd94-a5fb-4073-a486-6f0871ae5973 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Jul 21 17:44:07.728704 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 154/320] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:07 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:08.740516 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-411daeb4-033f-4e4f-94c2-61636ee2e791 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:08.741451 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-411daeb4-033f-4e4f-94c2-61636ee2e791 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:08.748783 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-411daeb4-033f-4e4f-94c2-61636ee2e791 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:08.749325 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-411daeb4-033f-4e4f-94c2-61636ee2e791 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:08.750191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-411daeb4-033f-4e4f-94c2-61636ee2e791 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:08.750643 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-411daeb4-033f-4e4f-94c2-61636ee2e791 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:08.788680 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-411daeb4-033f-4e4f-94c2-61636ee2e791 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052275 Jul 21 17:44:08.789325 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 167/321] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:09.800633 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8bc2c40b-aa76-49cf-ac57-487b142ab5f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:09.801552 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8bc2c40b-aa76-49cf-ac57-487b142ab5f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:09.807887 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8bc2c40b-aa76-49cf-ac57-487b142ab5f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:09.808365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8bc2c40b-aa76-49cf-ac57-487b142ab5f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:09.809130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8bc2c40b-aa76-49cf-ac57-487b142ab5f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:09.809562 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8bc2c40b-aa76-49cf-ac57-487b142ab5f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:09.839376 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8bc2c40b-aa76-49cf-ac57-487b142ab5f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043242 Jul 21 17:44:09.839913 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 155/322] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:10.850942 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-34ee751f-90a5-425e-af58-ccb57ff465eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:10.851875 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-34ee751f-90a5-425e-af58-ccb57ff465eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:10.858354 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-34ee751f-90a5-425e-af58-ccb57ff465eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:10.858811 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-34ee751f-90a5-425e-af58-ccb57ff465eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:10.859584 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-34ee751f-90a5-425e-af58-ccb57ff465eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:10.860026 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-34ee751f-90a5-425e-af58-ccb57ff465eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:10.888988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-34ee751f-90a5-425e-af58-ccb57ff465eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042119 Jul 21 17:44:10.889534 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 168/323] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:10 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:11.900979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cb666a40-8b75-4774-aa19-f76a289ebc02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:11.901931 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cb666a40-8b75-4774-aa19-f76a289ebc02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:11.908493 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb666a40-8b75-4774-aa19-f76a289ebc02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:11.908943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb666a40-8b75-4774-aa19-f76a289ebc02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:11.909700 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb666a40-8b75-4774-aa19-f76a289ebc02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:11.910188 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb666a40-8b75-4774-aa19-f76a289ebc02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:11.940360 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cb666a40-8b75-4774-aa19-f76a289ebc02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042907 Jul 21 17:44:11.941358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 156/324] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:11 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:12.952579 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9f1d7c06-4112-4971-ae2f-8fce18ba4da7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:12.953714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9f1d7c06-4112-4971-ae2f-8fce18ba4da7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:12.960608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9f1d7c06-4112-4971-ae2f-8fce18ba4da7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:12.961057 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9f1d7c06-4112-4971-ae2f-8fce18ba4da7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:12.961826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9f1d7c06-4112-4971-ae2f-8fce18ba4da7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:12.962256 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9f1d7c06-4112-4971-ae2f-8fce18ba4da7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:12.992772 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9f1d7c06-4112-4971-ae2f-8fce18ba4da7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 Jul 21 17:44:12.993325 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 169/325] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:12 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:13.893098 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 21 17:44:13.893376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 17:44:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:44:14.005024 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-94206128-9be6-48c3-a86d-1e5bae9f6231 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:14.005985 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-94206128-9be6-48c3-a86d-1e5bae9f6231 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:14.012429 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94206128-9be6-48c3-a86d-1e5bae9f6231 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:14.012879 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94206128-9be6-48c3-a86d-1e5bae9f6231 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:14.013637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94206128-9be6-48c3-a86d-1e5bae9f6231 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:14.014072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94206128-9be6-48c3-a86d-1e5bae9f6231 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:14.042897 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-94206128-9be6-48c3-a86d-1e5bae9f6231 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042553 Jul 21 17:44:14.043456 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 157/326] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:15.183157 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8b975181-3ea9-43a7-bbea-9ec83da65240 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:15.184074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8b975181-3ea9-43a7-bbea-9ec83da65240 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:15.191592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8b975181-3ea9-43a7-bbea-9ec83da65240 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:15.192043 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8b975181-3ea9-43a7-bbea-9ec83da65240 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:15.192822 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8b975181-3ea9-43a7-bbea-9ec83da65240 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:15.193259 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8b975181-3ea9-43a7-bbea-9ec83da65240 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:15.221476 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8b975181-3ea9-43a7-bbea-9ec83da65240 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170951 Jul 21 17:44:15.222018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 170/327] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:16.232975 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-89d5b2a7-2d59-4f84-b906-1c09e157a43d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:16.233940 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-89d5b2a7-2d59-4f84-b906-1c09e157a43d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:16.240420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89d5b2a7-2d59-4f84-b906-1c09e157a43d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:16.240868 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89d5b2a7-2d59-4f84-b906-1c09e157a43d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:16.241630 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89d5b2a7-2d59-4f84-b906-1c09e157a43d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:16.242061 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89d5b2a7-2d59-4f84-b906-1c09e157a43d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:16.270375 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-89d5b2a7-2d59-4f84-b906-1c09e157a43d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041347 Jul 21 17:44:16.270926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 158/328] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:16 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:17.281958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-09885753-1f42-4393-968c-6df17baff0b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:17.283612 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-09885753-1f42-4393-968c-6df17baff0b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:17.290082 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-09885753-1f42-4393-968c-6df17baff0b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:17.290533 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-09885753-1f42-4393-968c-6df17baff0b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:17.291295 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-09885753-1f42-4393-968c-6df17baff0b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:17.291734 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-09885753-1f42-4393-968c-6df17baff0b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:17.319734 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-09885753-1f42-4393-968c-6df17baff0b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041759 Jul 21 17:44:17.320284 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 171/329] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:17 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:18.057856 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:44:18.058022 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 17:44:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:44:18.331578 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b8620ed5-2acd-448a-bba7-8319f7828806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:18.332558 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b8620ed5-2acd-448a-bba7-8319f7828806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:18.338940 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8620ed5-2acd-448a-bba7-8319f7828806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:18.339384 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8620ed5-2acd-448a-bba7-8319f7828806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:18.340141 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8620ed5-2acd-448a-bba7-8319f7828806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:18.340604 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8620ed5-2acd-448a-bba7-8319f7828806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:18.369333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b8620ed5-2acd-448a-bba7-8319f7828806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041730 Jul 21 17:44:18.369865 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 159/330] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:18 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:19.381532 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6df42a27-ab72-4f67-8d2b-9b8d8677e080 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:19.382454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6df42a27-ab72-4f67-8d2b-9b8d8677e080 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:19.389008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6df42a27-ab72-4f67-8d2b-9b8d8677e080 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:19.389457 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6df42a27-ab72-4f67-8d2b-9b8d8677e080 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:19.390219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6df42a27-ab72-4f67-8d2b-9b8d8677e080 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:19.390656 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6df42a27-ab72-4f67-8d2b-9b8d8677e080 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:19.419397 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6df42a27-ab72-4f67-8d2b-9b8d8677e080 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042493 Jul 21 17:44:19.419939 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 172/331] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:19 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:20.430926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-38d52783-a67d-4c50-a39d-fa994972773a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:20.431847 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-38d52783-a67d-4c50-a39d-fa994972773a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:20.439226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-38d52783-a67d-4c50-a39d-fa994972773a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:20.439656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-38d52783-a67d-4c50-a39d-fa994972773a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:20.440479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-38d52783-a67d-4c50-a39d-fa994972773a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:20.440929 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-38d52783-a67d-4c50-a39d-fa994972773a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:20.469371 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-38d52783-a67d-4c50-a39d-fa994972773a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 Jul 21 17:44:20.470463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 160/332] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:20 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:21.481813 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0b150d77-cf80-47cf-ad0c-3b498631d37c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:21.482744 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0b150d77-cf80-47cf-ad0c-3b498631d37c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:21.490004 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0b150d77-cf80-47cf-ad0c-3b498631d37c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:21.490463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0b150d77-cf80-47cf-ad0c-3b498631d37c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:21.491240 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0b150d77-cf80-47cf-ad0c-3b498631d37c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:21.491687 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0b150d77-cf80-47cf-ad0c-3b498631d37c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:21.520481 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0b150d77-cf80-47cf-ad0c-3b498631d37c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042617 Jul 21 17:44:21.521032 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 173/333] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:22.531963 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8eb4b883-639e-4be4-8a78-6c1e781f6f0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:22.533524 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8eb4b883-639e-4be4-8a78-6c1e781f6f0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:22.535886 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=31 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:44:22.541369 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8eb4b883-639e-4be4-8a78-6c1e781f6f0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:22.541848 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8eb4b883-639e-4be4-8a78-6c1e781f6f0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:22.542615 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8eb4b883-639e-4be4-8a78-6c1e781f6f0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:22.543049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8eb4b883-639e-4be4-8a78-6c1e781f6f0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:22.546746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=91 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:44:22.572468 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8eb4b883-639e-4be4-8a78-6c1e781f6f0e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Jul 21 17:44:22.573028 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 161/334] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:22 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:23.584281 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0c6543ff-7a1b-4f6d-9dc2-01e507408cff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:23.585229 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0c6543ff-7a1b-4f6d-9dc2-01e507408cff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:23.587664 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=33 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:44:23.593004 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0c6543ff-7a1b-4f6d-9dc2-01e507408cff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:23.593468 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0c6543ff-7a1b-4f6d-9dc2-01e507408cff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:23.594235 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0c6543ff-7a1b-4f6d-9dc2-01e507408cff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:23.594675 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0c6543ff-7a1b-4f6d-9dc2-01e507408cff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:23.598593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=91 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:44:23.624059 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0c6543ff-7a1b-4f6d-9dc2-01e507408cff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044398 Jul 21 17:44:23.624647 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 174/335] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:23 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:24.635183 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-21c9d738-ce59-4f4d-8810-e6d1fb7d6931 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:24.636104 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-21c9d738-ce59-4f4d-8810-e6d1fb7d6931 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:24.643084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21c9d738-ce59-4f4d-8810-e6d1fb7d6931 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:24.643528 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21c9d738-ce59-4f4d-8810-e6d1fb7d6931 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:24.644289 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21c9d738-ce59-4f4d-8810-e6d1fb7d6931 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:24.644749 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21c9d738-ce59-4f4d-8810-e6d1fb7d6931 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:24.672500 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-21c9d738-ce59-4f4d-8810-e6d1fb7d6931 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 Jul 21 17:44:24.673563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 162/336] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:24 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:25.684921 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8beedf6a-0834-457a-b04b-daec56dad424 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:25.686115 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8beedf6a-0834-457a-b04b-daec56dad424 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:25.693273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8beedf6a-0834-457a-b04b-daec56dad424 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:25.693733 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8beedf6a-0834-457a-b04b-daec56dad424 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:25.694502 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8beedf6a-0834-457a-b04b-daec56dad424 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:25.694944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8beedf6a-0834-457a-b04b-daec56dad424 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:25.725807 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8beedf6a-0834-457a-b04b-daec56dad424 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044909 Jul 21 17:44:25.726350 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 175/337] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:25 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:26.737896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bc5d92a4-1508-4d34-8510-e5f22a1a4a00 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:26.738860 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bc5d92a4-1508-4d34-8510-e5f22a1a4a00 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:26.745342 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bc5d92a4-1508-4d34-8510-e5f22a1a4a00 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:26.745797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bc5d92a4-1508-4d34-8510-e5f22a1a4a00 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:26.746574 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bc5d92a4-1508-4d34-8510-e5f22a1a4a00 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:26.747014 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bc5d92a4-1508-4d34-8510-e5f22a1a4a00 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:26.775474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bc5d92a4-1508-4d34-8510-e5f22a1a4a00 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042144 Jul 21 17:44:26.776022 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 163/338] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:26 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:27.786899 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8e15b698-f5a7-4ed4-8698-8d56b5cd5671 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:27.787817 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8e15b698-f5a7-4ed4-8698-8d56b5cd5671 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:27.795206 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8e15b698-f5a7-4ed4-8698-8d56b5cd5671 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:27.795654 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8e15b698-f5a7-4ed4-8698-8d56b5cd5671 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:27.796438 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8e15b698-f5a7-4ed4-8698-8d56b5cd5671 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:27.796875 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8e15b698-f5a7-4ed4-8698-8d56b5cd5671 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:27.825028 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8e15b698-f5a7-4ed4-8698-8d56b5cd5671 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042102 Jul 21 17:44:27.825563 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 176/339] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:27 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:28.836519 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9b5d1e0d-4321-4869-a48b-64d2cab51e52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:28.837488 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9b5d1e0d-4321-4869-a48b-64d2cab51e52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:28.843932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b5d1e0d-4321-4869-a48b-64d2cab51e52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:28.844424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b5d1e0d-4321-4869-a48b-64d2cab51e52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:28.845236 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b5d1e0d-4321-4869-a48b-64d2cab51e52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:28.845675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b5d1e0d-4321-4869-a48b-64d2cab51e52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:28.873947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9b5d1e0d-4321-4869-a48b-64d2cab51e52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041384 Jul 21 17:44:28.874494 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 164/340] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:28 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:29.885881 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-57cca45d-d2c6-4c90-a401-bbe9732ed07e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:29.886801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-57cca45d-d2c6-4c90-a401-bbe9732ed07e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:29.893461 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-57cca45d-d2c6-4c90-a401-bbe9732ed07e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:29.893909 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-57cca45d-d2c6-4c90-a401-bbe9732ed07e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:29.894666 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-57cca45d-d2c6-4c90-a401-bbe9732ed07e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:29.895101 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-57cca45d-d2c6-4c90-a401-bbe9732ed07e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:29.923765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-57cca45d-d2c6-4c90-a401-bbe9732ed07e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041291 Jul 21 17:44:29.924331 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 177/341] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:29 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:30.935603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-634918d2-da70-4ea3-a15c-02dc0936e401 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:30.936247 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-634918d2-da70-4ea3-a15c-02dc0936e401 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:30.943081 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-634918d2-da70-4ea3-a15c-02dc0936e401 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:30.943538 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-634918d2-da70-4ea3-a15c-02dc0936e401 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:30.944324 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-634918d2-da70-4ea3-a15c-02dc0936e401 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:30.944778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-634918d2-da70-4ea3-a15c-02dc0936e401 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:30.973854 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-634918d2-da70-4ea3-a15c-02dc0936e401 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042628 Jul 21 17:44:30.974328 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 165/342] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:30 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:31.553310 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 21 17:44:31.553906 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 17:44:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:44:31.985106 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f710c74b-2a31-48c7-bc5e-18c5be685eda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:31.986091 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f710c74b-2a31-48c7-bc5e-18c5be685eda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:31.992162 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f710c74b-2a31-48c7-bc5e-18c5be685eda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:31.992654 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f710c74b-2a31-48c7-bc5e-18c5be685eda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:31.993423 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f710c74b-2a31-48c7-bc5e-18c5be685eda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:31.993874 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f710c74b-2a31-48c7-bc5e-18c5be685eda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:32.022754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f710c74b-2a31-48c7-bc5e-18c5be685eda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041753 Jul 21 17:44:32.023294 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 178/343] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:33.034244 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2f4c1960-373d-4396-8c76-d03ed322ce9f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:33.035156 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2f4c1960-373d-4396-8c76-d03ed322ce9f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:33.041831 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f4c1960-373d-4396-8c76-d03ed322ce9f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:33.042286 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f4c1960-373d-4396-8c76-d03ed322ce9f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:33.043059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f4c1960-373d-4396-8c76-d03ed322ce9f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:33.043502 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f4c1960-373d-4396-8c76-d03ed322ce9f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:33.073253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2f4c1960-373d-4396-8c76-d03ed322ce9f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 Jul 21 17:44:33.073730 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 166/344] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:33 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:34.084264 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2bd33f8c-7c39-4f47-963b-a49a870de13b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:34.085253 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2bd33f8c-7c39-4f47-963b-a49a870de13b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:34.091720 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2bd33f8c-7c39-4f47-963b-a49a870de13b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:34.092177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2bd33f8c-7c39-4f47-963b-a49a870de13b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:34.092956 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2bd33f8c-7c39-4f47-963b-a49a870de13b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:34.093392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2bd33f8c-7c39-4f47-963b-a49a870de13b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:34.122522 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2bd33f8c-7c39-4f47-963b-a49a870de13b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042148 Jul 21 17:44:34.122999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 179/345] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:34 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:35.133954 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7386a8a8-3e9f-42de-8359-9efc044331b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:35.134877 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7386a8a8-3e9f-42de-8359-9efc044331b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:35.141251 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7386a8a8-3e9f-42de-8359-9efc044331b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:35.141754 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7386a8a8-3e9f-42de-8359-9efc044331b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:35.142828 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7386a8a8-3e9f-42de-8359-9efc044331b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:35.143266 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7386a8a8-3e9f-42de-8359-9efc044331b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:35.171649 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7386a8a8-3e9f-42de-8359-9efc044331b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041627 Jul 21 17:44:35.172120 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 167/346] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:35 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:36.183028 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-98c9fe31-c700-4ab6-836b-fb21f44135c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:36.183955 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-98c9fe31-c700-4ab6-836b-fb21f44135c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:36.192729 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98c9fe31-c700-4ab6-836b-fb21f44135c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:36.193179 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98c9fe31-c700-4ab6-836b-fb21f44135c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:36.194401 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98c9fe31-c700-4ab6-836b-fb21f44135c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:36.194401 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98c9fe31-c700-4ab6-836b-fb21f44135c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:36.224808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-98c9fe31-c700-4ab6-836b-fb21f44135c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045683 Jul 21 17:44:36.225352 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 180/347] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:36 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:37.237064 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-da8c1a1c-0e3d-4a23-a038-d1694cbaae22 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:37.237890 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-da8c1a1c-0e3d-4a23-a038-d1694cbaae22 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:37.244355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da8c1a1c-0e3d-4a23-a038-d1694cbaae22 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:37.244807 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da8c1a1c-0e3d-4a23-a038-d1694cbaae22 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:37.245563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da8c1a1c-0e3d-4a23-a038-d1694cbaae22 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:37.246020 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da8c1a1c-0e3d-4a23-a038-d1694cbaae22 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:37.274387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-da8c1a1c-0e3d-4a23-a038-d1694cbaae22 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042087 Jul 21 17:44:37.274919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 168/348] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:37 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:38.286452 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9643bb69-7ed3-4287-898f-9bc0c90dfd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:38.287395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9643bb69-7ed3-4287-898f-9bc0c90dfd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:38.293929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9643bb69-7ed3-4287-898f-9bc0c90dfd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:38.294388 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9643bb69-7ed3-4287-898f-9bc0c90dfd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:38.295159 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9643bb69-7ed3-4287-898f-9bc0c90dfd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:38.295604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9643bb69-7ed3-4287-898f-9bc0c90dfd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:38.324787 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9643bb69-7ed3-4287-898f-9bc0c90dfd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042720 Jul 21 17:44:38.325337 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 181/349] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:38 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:39.336349 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-925e6a90-c85e-40b6-a9e1-afd242692fa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:39.337246 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-925e6a90-c85e-40b6-a9e1-afd242692fa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:39.343808 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-925e6a90-c85e-40b6-a9e1-afd242692fa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:39.344266 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-925e6a90-c85e-40b6-a9e1-afd242692fa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:39.345721 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-925e6a90-c85e-40b6-a9e1-afd242692fa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:39.346169 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-925e6a90-c85e-40b6-a9e1-afd242692fa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:39.374759 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-925e6a90-c85e-40b6-a9e1-afd242692fa8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042497 Jul 21 17:44:39.375300 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 169/350] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:39 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:40.388097 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3e0f1145-7614-44b8-93d7-5670fe7bb56a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:40.389267 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3e0f1145-7614-44b8-93d7-5670fe7bb56a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:40.396235 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3e0f1145-7614-44b8-93d7-5670fe7bb56a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:40.396718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3e0f1145-7614-44b8-93d7-5670fe7bb56a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:40.397485 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3e0f1145-7614-44b8-93d7-5670fe7bb56a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:40.397928 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3e0f1145-7614-44b8-93d7-5670fe7bb56a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:40.427593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3e0f1145-7614-44b8-93d7-5670fe7bb56a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044716 Jul 21 17:44:40.428101 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 182/351] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:41.439933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1adc0736-39fd-4dd2-8360-4c1b0fab2b6d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:41.440795 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1adc0736-39fd-4dd2-8360-4c1b0fab2b6d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:41.447238 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1adc0736-39fd-4dd2-8360-4c1b0fab2b6d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:41.447691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1adc0736-39fd-4dd2-8360-4c1b0fab2b6d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:41.448497 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1adc0736-39fd-4dd2-8360-4c1b0fab2b6d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:41.448937 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1adc0736-39fd-4dd2-8360-4c1b0fab2b6d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:41.478128 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1adc0736-39fd-4dd2-8360-4c1b0fab2b6d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043178 Jul 21 17:44:41.478675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 170/352] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:41 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:42.489820 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4ed5496a-11b7-4b0f-b1f5-c0f9d451680d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:42.490734 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4ed5496a-11b7-4b0f-b1f5-c0f9d451680d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:42.497191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4ed5496a-11b7-4b0f-b1f5-c0f9d451680d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:42.497637 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4ed5496a-11b7-4b0f-b1f5-c0f9d451680d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:42.498436 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4ed5496a-11b7-4b0f-b1f5-c0f9d451680d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:42.498817 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4ed5496a-11b7-4b0f-b1f5-c0f9d451680d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:42.527828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4ed5496a-11b7-4b0f-b1f5-c0f9d451680d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042014 Jul 21 17:44:42.528389 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 183/353] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:42 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:43.539871 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-666c14ed-6a8b-4f67-b4be-f994d65517db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:43.540824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-666c14ed-6a8b-4f67-b4be-f994d65517db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:43.547455 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-666c14ed-6a8b-4f67-b4be-f994d65517db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:43.547936 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-666c14ed-6a8b-4f67-b4be-f994d65517db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:43.548729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-666c14ed-6a8b-4f67-b4be-f994d65517db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:43.549231 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-666c14ed-6a8b-4f67-b4be-f994d65517db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:43.577014 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-666c14ed-6a8b-4f67-b4be-f994d65517db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041118 Jul 21 17:44:43.577557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 171/354] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:44.589074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-94ce8033-2775-4cb0-88c1-281eff856e74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:44.589910 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-94ce8033-2775-4cb0-88c1-281eff856e74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:44.596991 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-94ce8033-2775-4cb0-88c1-281eff856e74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:44.597440 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-94ce8033-2775-4cb0-88c1-281eff856e74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:44.598204 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-94ce8033-2775-4cb0-88c1-281eff856e74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:44.598637 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-94ce8033-2775-4cb0-88c1-281eff856e74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:44.627353 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-94ce8033-2775-4cb0-88c1-281eff856e74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042273 Jul 21 17:44:44.627895 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 184/355] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:44 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:45.638773 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e42af0dc-16c0-4d20-bb82-4d190387ce17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:45.639717 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e42af0dc-16c0-4d20-bb82-4d190387ce17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:45.646236 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e42af0dc-16c0-4d20-bb82-4d190387ce17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:45.646624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e42af0dc-16c0-4d20-bb82-4d190387ce17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:45.647383 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e42af0dc-16c0-4d20-bb82-4d190387ce17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:45.647810 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e42af0dc-16c0-4d20-bb82-4d190387ce17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:45.676375 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e42af0dc-16c0-4d20-bb82-4d190387ce17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041497 Jul 21 17:44:45.676915 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 172/356] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:45 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:46.687908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e6bea0b0-1409-4379-8411-3db67f9a46b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:46.689080 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e6bea0b0-1409-4379-8411-3db67f9a46b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:46.695502 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6bea0b0-1409-4379-8411-3db67f9a46b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:46.695949 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6bea0b0-1409-4379-8411-3db67f9a46b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:46.696735 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6bea0b0-1409-4379-8411-3db67f9a46b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:46.697170 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6bea0b0-1409-4379-8411-3db67f9a46b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:46.725793 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e6bea0b0-1409-4379-8411-3db67f9a46b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042056 Jul 21 17:44:46.726329 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 185/357] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:46 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:47.737909 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-35c413ec-c7a2-4a79-827a-8575a7f5d0ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:47.738867 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-35c413ec-c7a2-4a79-827a-8575a7f5d0ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:47.745333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35c413ec-c7a2-4a79-827a-8575a7f5d0ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:47.745829 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35c413ec-c7a2-4a79-827a-8575a7f5d0ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:47.746533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35c413ec-c7a2-4a79-827a-8575a7f5d0ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:47.746967 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35c413ec-c7a2-4a79-827a-8575a7f5d0ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:47.775774 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-35c413ec-c7a2-4a79-827a-8575a7f5d0ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042492 Jul 21 17:44:47.776315 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 173/358] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:48.787744 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-29559c9e-04d1-47db-b41f-71ec71ff37c8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:48.788690 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-29559c9e-04d1-47db-b41f-71ec71ff37c8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:48.795211 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-29559c9e-04d1-47db-b41f-71ec71ff37c8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:48.795611 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-29559c9e-04d1-47db-b41f-71ec71ff37c8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:48.796398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-29559c9e-04d1-47db-b41f-71ec71ff37c8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:48.796833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-29559c9e-04d1-47db-b41f-71ec71ff37c8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:48.824798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-29559c9e-04d1-47db-b41f-71ec71ff37c8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041749 Jul 21 17:44:48.825331 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 186/359] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:48 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:49.836321 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-09214138-4c9f-4608-b908-d75fd1572865 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:49.837285 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-09214138-4c9f-4608-b908-d75fd1572865 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:49.843684 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09214138-4c9f-4608-b908-d75fd1572865 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:49.844081 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09214138-4c9f-4608-b908-d75fd1572865 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:49.844870 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09214138-4c9f-4608-b908-d75fd1572865 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:49.845379 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09214138-4c9f-4608-b908-d75fd1572865 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:49.873001 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-09214138-4c9f-4608-b908-d75fd1572865 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040571 Jul 21 17:44:49.873537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 174/360] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:49 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:50.885027 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-98d8b08d-0a8b-4762-9779-65fc5ecd40a4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:50.885976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-98d8b08d-0a8b-4762-9779-65fc5ecd40a4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:50.893108 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98d8b08d-0a8b-4762-9779-65fc5ecd40a4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:50.893493 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98d8b08d-0a8b-4762-9779-65fc5ecd40a4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:50.894248 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98d8b08d-0a8b-4762-9779-65fc5ecd40a4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:50.894680 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98d8b08d-0a8b-4762-9779-65fc5ecd40a4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:50.924883 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-98d8b08d-0a8b-4762-9779-65fc5ecd40a4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Jul 21 17:44:50.925442 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 187/361] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:50 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:51.936819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7993792e-c2f4-4a01-bcc4-2258ee5d69e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:51.937749 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7993792e-c2f4-4a01-bcc4-2258ee5d69e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:51.944207 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7993792e-c2f4-4a01-bcc4-2258ee5d69e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:51.944686 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7993792e-c2f4-4a01-bcc4-2258ee5d69e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:51.945479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7993792e-c2f4-4a01-bcc4-2258ee5d69e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:51.945912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7993792e-c2f4-4a01-bcc4-2258ee5d69e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:51.974497 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7993792e-c2f4-4a01-bcc4-2258ee5d69e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Jul 21 17:44:51.975035 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 175/362] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:52.987122 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d0812bc0-3715-440b-8f08-621f2332335b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:52.988012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d0812bc0-3715-440b-8f08-621f2332335b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:52.994586 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d0812bc0-3715-440b-8f08-621f2332335b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:52.995040 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d0812bc0-3715-440b-8f08-621f2332335b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:52.995802 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d0812bc0-3715-440b-8f08-621f2332335b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:52.996241 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d0812bc0-3715-440b-8f08-621f2332335b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:53.025822 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d0812bc0-3715-440b-8f08-621f2332335b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043417 Jul 21 17:44:53.026366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 188/363] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:52 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:54.038079 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fbf75f3b-116b-4918-b100-296a29416d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:54.039183 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fbf75f3b-116b-4918-b100-296a29416d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:54.042043 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=30 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:44:54.047519 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fbf75f3b-116b-4918-b100-296a29416d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:54.048179 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fbf75f3b-116b-4918-b100-296a29416d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:54.049014 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fbf75f3b-116b-4918-b100-296a29416d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:54.049450 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fbf75f3b-116b-4918-b100-296a29416d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:54.051938 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=90 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:44:54.079880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fbf75f3b-116b-4918-b100-296a29416d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Jul 21 17:44:54.080467 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 176/364] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:54 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:55.091352 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1e47039f-628b-4237-995b-263bc7f4816c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:55.092223 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1e47039f-628b-4237-995b-263bc7f4816c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:55.094600 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=30 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:44:55.100896 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1e47039f-628b-4237-995b-263bc7f4816c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:55.101347 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1e47039f-628b-4237-995b-263bc7f4816c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:55.102115 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1e47039f-628b-4237-995b-263bc7f4816c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:55.102552 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1e47039f-628b-4237-995b-263bc7f4816c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:55.105119 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=90 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:44:55.133856 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1e47039f-628b-4237-995b-263bc7f4816c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046411 Jul 21 17:44:55.134435 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 189/365] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:55 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:56.145892 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fd2e27eb-781d-4bfa-bd2d-9e2f72ef8f79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:56.146752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fd2e27eb-781d-4bfa-bd2d-9e2f72ef8f79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:56.153340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd2e27eb-781d-4bfa-bd2d-9e2f72ef8f79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:56.153797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd2e27eb-781d-4bfa-bd2d-9e2f72ef8f79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:56.154566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd2e27eb-781d-4bfa-bd2d-9e2f72ef8f79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:56.155007 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd2e27eb-781d-4bfa-bd2d-9e2f72ef8f79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:56.183621 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fd2e27eb-781d-4bfa-bd2d-9e2f72ef8f79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 Jul 21 17:44:56.184167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 177/366] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:56 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:44:57.195893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6f3e67f2-8efe-4726-b0cd-c16301e992b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:57.196767 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6f3e67f2-8efe-4726-b0cd-c16301e992b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:57.203315 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6f3e67f2-8efe-4726-b0cd-c16301e992b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:57.203766 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6f3e67f2-8efe-4726-b0cd-c16301e992b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:57.205148 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6f3e67f2-8efe-4726-b0cd-c16301e992b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:57.205587 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6f3e67f2-8efe-4726-b0cd-c16301e992b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:57.233859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6f3e67f2-8efe-4726-b0cd-c16301e992b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Jul 21 17:44:57.234404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 190/367] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:57 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:58.245728 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-433c8a0f-3e5f-49e8-86e7-b818cea8e4f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:58.246609 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-433c8a0f-3e5f-49e8-86e7-b818cea8e4f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:58.253132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-433c8a0f-3e5f-49e8-86e7-b818cea8e4f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:58.253587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-433c8a0f-3e5f-49e8-86e7-b818cea8e4f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:58.254361 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-433c8a0f-3e5f-49e8-86e7-b818cea8e4f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:58.254808 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-433c8a0f-3e5f-49e8-86e7-b818cea8e4f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:58.284624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-433c8a0f-3e5f-49e8-86e7-b818cea8e4f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042951 Jul 21 17:44:58.285171 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 178/368] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:58 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:44:59.296270 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dc7cf568-bdc7-49fa-9710-c19b0eda7b54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:44:59.297151 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dc7cf568-bdc7-49fa-9710-c19b0eda7b54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:44:59.303835 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc7cf568-bdc7-49fa-9710-c19b0eda7b54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:59.304275 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc7cf568-bdc7-49fa-9710-c19b0eda7b54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:59.305090 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc7cf568-bdc7-49fa-9710-c19b0eda7b54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:44:59.305537 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc7cf568-bdc7-49fa-9710-c19b0eda7b54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:44:59.334735 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dc7cf568-bdc7-49fa-9710-c19b0eda7b54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042607 Jul 21 17:44:59.335279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 191/369] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:44:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:00.346841 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6175616b-53cf-4300-91b1-92944db4771b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:00.347796 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6175616b-53cf-4300-91b1-92944db4771b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:00.354288 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6175616b-53cf-4300-91b1-92944db4771b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:00.354682 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6175616b-53cf-4300-91b1-92944db4771b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:00.355452 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6175616b-53cf-4300-91b1-92944db4771b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:00.355896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6175616b-53cf-4300-91b1-92944db4771b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:00.385466 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6175616b-53cf-4300-91b1-92944db4771b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043091 Jul 21 17:45:00.386020 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 179/370] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:01.397112 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e1c44460-91b6-4b38-b083-9082e66c4be8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:01.398039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e1c44460-91b6-4b38-b083-9082e66c4be8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:01.404122 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1c44460-91b6-4b38-b083-9082e66c4be8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:01.404610 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1c44460-91b6-4b38-b083-9082e66c4be8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:01.405376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1c44460-91b6-4b38-b083-9082e66c4be8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:01.405813 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1c44460-91b6-4b38-b083-9082e66c4be8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:01.434149 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e1c44460-91b6-4b38-b083-9082e66c4be8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041151 Jul 21 17:45:01.434692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 192/371] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:01 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:02.446065 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-be019be7-64a3-4f1e-9abd-a1496f109dcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:02.446941 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-be019be7-64a3-4f1e-9abd-a1496f109dcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:02.452990 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be019be7-64a3-4f1e-9abd-a1496f109dcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:02.453440 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be019be7-64a3-4f1e-9abd-a1496f109dcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:02.454854 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be019be7-64a3-4f1e-9abd-a1496f109dcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:02.455292 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be019be7-64a3-4f1e-9abd-a1496f109dcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:02.482916 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-be019be7-64a3-4f1e-9abd-a1496f109dcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041021 Jul 21 17:45:02.483447 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 180/372] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:03.494951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fb3bb6f5-228d-4d38-91ed-248e30c19755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:03.495851 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fb3bb6f5-228d-4d38-91ed-248e30c19755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:03.502322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb3bb6f5-228d-4d38-91ed-248e30c19755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:03.502765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb3bb6f5-228d-4d38-91ed-248e30c19755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:03.503791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb3bb6f5-228d-4d38-91ed-248e30c19755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:03.504228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb3bb6f5-228d-4d38-91ed-248e30c19755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:03.533022 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fb3bb6f5-228d-4d38-91ed-248e30c19755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041471 Jul 21 17:45:03.533863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 193/373] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:03 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:04.544813 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d082a561-1104-4fd1-a350-1850e50d8cdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:04.545673 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d082a561-1104-4fd1-a350-1850e50d8cdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:04.552348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d082a561-1104-4fd1-a350-1850e50d8cdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:04.552808 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d082a561-1104-4fd1-a350-1850e50d8cdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:04.553600 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d082a561-1104-4fd1-a350-1850e50d8cdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:04.554048 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d082a561-1104-4fd1-a350-1850e50d8cdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:04.583334 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d082a561-1104-4fd1-a350-1850e50d8cdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042595 Jul 21 17:45:04.583887 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 181/374] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:04 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:05.596160 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-530a835f-7c05-4598-9620-2d3c50cf6a76 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:05.597052 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-530a835f-7c05-4598-9620-2d3c50cf6a76 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:05.603530 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-530a835f-7c05-4598-9620-2d3c50cf6a76 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:05.603983 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-530a835f-7c05-4598-9620-2d3c50cf6a76 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:05.604773 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-530a835f-7c05-4598-9620-2d3c50cf6a76 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:05.605214 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-530a835f-7c05-4598-9620-2d3c50cf6a76 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:05.635309 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-530a835f-7c05-4598-9620-2d3c50cf6a76 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044423 Jul 21 17:45:05.635855 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 194/375] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:06.647357 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-866679b5-be91-47b8-af02-8a8f85f5493e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:06.648319 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-866679b5-be91-47b8-af02-8a8f85f5493e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:06.654778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-866679b5-be91-47b8-af02-8a8f85f5493e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:06.655236 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-866679b5-be91-47b8-af02-8a8f85f5493e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:06.656020 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-866679b5-be91-47b8-af02-8a8f85f5493e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:06.656504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-866679b5-be91-47b8-af02-8a8f85f5493e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:06.686323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-866679b5-be91-47b8-af02-8a8f85f5493e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Jul 21 17:45:06.687157 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 182/376] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:06 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:07.698364 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4d2f0240-0dcc-4c37-b650-d2d69c33a0cc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:07.699286 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4d2f0240-0dcc-4c37-b650-d2d69c33a0cc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:07.707581 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4d2f0240-0dcc-4c37-b650-d2d69c33a0cc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:07.708030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4d2f0240-0dcc-4c37-b650-d2d69c33a0cc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:07.708842 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4d2f0240-0dcc-4c37-b650-d2d69c33a0cc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:07.709275 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4d2f0240-0dcc-4c37-b650-d2d69c33a0cc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:07.741030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4d2f0240-0dcc-4c37-b650-d2d69c33a0cc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046567 Jul 21 17:45:07.741593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 195/377] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:07 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:08.753914 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-29d4b2b2-a630-4163-a3fa-2c507b0b9c17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:08.754873 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-29d4b2b2-a630-4163-a3fa-2c507b0b9c17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:08.761269 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-29d4b2b2-a630-4163-a3fa-2c507b0b9c17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:08.761722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-29d4b2b2-a630-4163-a3fa-2c507b0b9c17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:08.762486 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-29d4b2b2-a630-4163-a3fa-2c507b0b9c17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:08.762920 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-29d4b2b2-a630-4163-a3fa-2c507b0b9c17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:08.791373 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-29d4b2b2-a630-4163-a3fa-2c507b0b9c17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042634 Jul 21 17:45:08.791915 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 183/378] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:09.802382 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0d1a6767-fb6a-44a4-9884-d96ba4d8e8f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:09.803307 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0d1a6767-fb6a-44a4-9884-d96ba4d8e8f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:09.809752 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0d1a6767-fb6a-44a4-9884-d96ba4d8e8f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:09.810201 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0d1a6767-fb6a-44a4-9884-d96ba4d8e8f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:09.810958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0d1a6767-fb6a-44a4-9884-d96ba4d8e8f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:09.811394 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0d1a6767-fb6a-44a4-9884-d96ba4d8e8f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:09.840528 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0d1a6767-fb6a-44a4-9884-d96ba4d8e8f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041946 Jul 21 17:45:09.841086 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 196/379] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:10.852348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7234d675-3eb3-4da6-a431-1d1036358735 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:10.853214 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7234d675-3eb3-4da6-a431-1d1036358735 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:10.859554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7234d675-3eb3-4da6-a431-1d1036358735 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:10.860004 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7234d675-3eb3-4da6-a431-1d1036358735 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:10.861449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7234d675-3eb3-4da6-a431-1d1036358735 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:10.861952 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7234d675-3eb3-4da6-a431-1d1036358735 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:10.889812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7234d675-3eb3-4da6-a431-1d1036358735 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041500 Jul 21 17:45:10.890357 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 184/380] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:10 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:11.901100 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-80c1e788-fe69-4b2b-b8dd-094861da3eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:11.902061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-80c1e788-fe69-4b2b-b8dd-094861da3eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:11.909156 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80c1e788-fe69-4b2b-b8dd-094861da3eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:11.909618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80c1e788-fe69-4b2b-b8dd-094861da3eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:11.910386 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80c1e788-fe69-4b2b-b8dd-094861da3eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:11.910824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80c1e788-fe69-4b2b-b8dd-094861da3eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:11.941840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-80c1e788-fe69-4b2b-b8dd-094861da3eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Jul 21 17:45:11.942405 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 197/381] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:11 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:12.953469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-568f01a1-b0c6-4d20-b736-2f123e678455 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:12.955158 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-568f01a1-b0c6-4d20-b736-2f123e678455 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:12.961599 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-568f01a1-b0c6-4d20-b736-2f123e678455 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:12.962048 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-568f01a1-b0c6-4d20-b736-2f123e678455 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:12.962809 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-568f01a1-b0c6-4d20-b736-2f123e678455 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:12.963240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-568f01a1-b0c6-4d20-b736-2f123e678455 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:12.991774 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-568f01a1-b0c6-4d20-b736-2f123e678455 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042208 Jul 21 17:45:12.992338 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 185/382] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:12 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:14.003427 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3641e201-7155-46de-a73b-dc4415ef9263 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:14.004370 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3641e201-7155-46de-a73b-dc4415ef9263 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:14.010790 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3641e201-7155-46de-a73b-dc4415ef9263 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:14.011235 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3641e201-7155-46de-a73b-dc4415ef9263 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:14.011991 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3641e201-7155-46de-a73b-dc4415ef9263 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:14.012463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3641e201-7155-46de-a73b-dc4415ef9263 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:14.042183 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3641e201-7155-46de-a73b-dc4415ef9263 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042866 Jul 21 17:45:14.042727 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 198/383] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:15.054962 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d585681d-7508-4bec-b731-356459bcc5e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:15.055890 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d585681d-7508-4bec-b731-356459bcc5e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:15.062751 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d585681d-7508-4bec-b731-356459bcc5e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:15.063204 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d585681d-7508-4bec-b731-356459bcc5e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:15.064724 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d585681d-7508-4bec-b731-356459bcc5e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:15.065181 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d585681d-7508-4bec-b731-356459bcc5e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:15.093613 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d585681d-7508-4bec-b731-356459bcc5e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042622 Jul 21 17:45:15.094157 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 186/384] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:16.105779 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-488ba88b-b3f6-462e-8a7d-b3e6031b2223 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:16.106716 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-488ba88b-b3f6-462e-8a7d-b3e6031b2223 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:16.113340 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-488ba88b-b3f6-462e-8a7d-b3e6031b2223 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:16.113791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-488ba88b-b3f6-462e-8a7d-b3e6031b2223 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:16.114554 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-488ba88b-b3f6-462e-8a7d-b3e6031b2223 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:16.114992 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-488ba88b-b3f6-462e-8a7d-b3e6031b2223 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:16.144819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-488ba88b-b3f6-462e-8a7d-b3e6031b2223 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042974 Jul 21 17:45:16.145368 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 199/385] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:16 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:45:17.156612 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2c6360d8-0504-448b-bcb6-697704f49d85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:17.158153 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2c6360d8-0504-448b-bcb6-697704f49d85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:17.164591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c6360d8-0504-448b-bcb6-697704f49d85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:17.165040 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c6360d8-0504-448b-bcb6-697704f49d85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:17.165799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c6360d8-0504-448b-bcb6-697704f49d85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:17.166236 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c6360d8-0504-448b-bcb6-697704f49d85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:17.194201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2c6360d8-0504-448b-bcb6-697704f49d85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041564 Jul 21 17:45:17.194743 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 187/386] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:17 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:18.205640 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ebd5770e-da58-4d6c-93c3-58b690811e3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:18.206565 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ebd5770e-da58-4d6c-93c3-58b690811e3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:18.213018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ebd5770e-da58-4d6c-93c3-58b690811e3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:18.213466 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ebd5770e-da58-4d6c-93c3-58b690811e3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:18.214226 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ebd5770e-da58-4d6c-93c3-58b690811e3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:18.214688 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ebd5770e-da58-4d6c-93c3-58b690811e3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:18.244711 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ebd5770e-da58-4d6c-93c3-58b690811e3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043000 Jul 21 17:45:18.245251 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 200/387] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:18 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:19.256514 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e7c23895-5991-4244-b8f7-3bf285159157 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:19.257439 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e7c23895-5991-4244-b8f7-3bf285159157 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:19.263922 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e7c23895-5991-4244-b8f7-3bf285159157 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:19.264407 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e7c23895-5991-4244-b8f7-3bf285159157 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:19.265172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e7c23895-5991-4244-b8f7-3bf285159157 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:19.265611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e7c23895-5991-4244-b8f7-3bf285159157 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:19.293665 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e7c23895-5991-4244-b8f7-3bf285159157 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041115 Jul 21 17:45:19.294213 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 188/388] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:19 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:20.305161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bfd46456-d18a-4f0a-905f-cb8a9e891a81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:20.306040 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bfd46456-d18a-4f0a-905f-cb8a9e891a81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:20.312765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bfd46456-d18a-4f0a-905f-cb8a9e891a81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:20.313210 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bfd46456-d18a-4f0a-905f-cb8a9e891a81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:20.313960 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bfd46456-d18a-4f0a-905f-cb8a9e891a81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:20.314393 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bfd46456-d18a-4f0a-905f-cb8a9e891a81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:20.343027 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bfd46456-d18a-4f0a-905f-cb8a9e891a81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041880 Jul 21 17:45:20.343564 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 201/389] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:20 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:21.355106 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9f906336-f2df-4dc2-8b57-c4f128a6395d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:21.355948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9f906336-f2df-4dc2-8b57-c4f128a6395d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:21.363107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f906336-f2df-4dc2-8b57-c4f128a6395d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:21.363598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f906336-f2df-4dc2-8b57-c4f128a6395d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:21.364396 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f906336-f2df-4dc2-8b57-c4f128a6395d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:21.364838 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f906336-f2df-4dc2-8b57-c4f128a6395d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:21.393511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9f906336-f2df-4dc2-8b57-c4f128a6395d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042395 Jul 21 17:45:21.394058 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 189/390] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:22.404922 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3513093a-f048-4992-a6ed-51fb8f96e26a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:22.405848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3513093a-f048-4992-a6ed-51fb8f96e26a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:22.412906 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3513093a-f048-4992-a6ed-51fb8f96e26a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:22.413302 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3513093a-f048-4992-a6ed-51fb8f96e26a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:22.414067 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3513093a-f048-4992-a6ed-51fb8f96e26a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:22.414505 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3513093a-f048-4992-a6ed-51fb8f96e26a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:22.444547 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3513093a-f048-4992-a6ed-51fb8f96e26a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043501 Jul 21 17:45:22.445086 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 202/391] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:22 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:23.456640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9ed239bc-f63f-4548-8f25-e4ecc8e0f3bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:23.457479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9ed239bc-f63f-4548-8f25-e4ecc8e0f3bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:23.463878 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ed239bc-f63f-4548-8f25-e4ecc8e0f3bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:23.464396 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ed239bc-f63f-4548-8f25-e4ecc8e0f3bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:23.465172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ed239bc-f63f-4548-8f25-e4ecc8e0f3bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:23.465609 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ed239bc-f63f-4548-8f25-e4ecc8e0f3bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:23.493732 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9ed239bc-f63f-4548-8f25-e4ecc8e0f3bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041790 Jul 21 17:45:23.494275 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 190/392] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:23 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:24.505290 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1a52c5d5-8972-4f87-8539-587bb58d5b43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:24.506132 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1a52c5d5-8972-4f87-8539-587bb58d5b43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:24.512618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a52c5d5-8972-4f87-8539-587bb58d5b43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:24.513065 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a52c5d5-8972-4f87-8539-587bb58d5b43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:24.513830 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a52c5d5-8972-4f87-8539-587bb58d5b43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:24.514262 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a52c5d5-8972-4f87-8539-587bb58d5b43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:24.543589 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1a52c5d5-8972-4f87-8539-587bb58d5b43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042292 Jul 21 17:45:24.544128 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 203/393] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:24 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:25.554740 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-203e8b5a-aeb8-4ebf-bc0d-98eb37a4bed6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:25.555594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-203e8b5a-aeb8-4ebf-bc0d-98eb37a4bed6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:25.557991 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=30 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:45:25.563480 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-203e8b5a-aeb8-4ebf-bc0d-98eb37a4bed6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:25.563930 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-203e8b5a-aeb8-4ebf-bc0d-98eb37a4bed6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:25.565479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-203e8b5a-aeb8-4ebf-bc0d-98eb37a4bed6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:25.565921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-203e8b5a-aeb8-4ebf-bc0d-98eb37a4bed6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:25.569722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=90 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:45:25.595486 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-203e8b5a-aeb8-4ebf-bc0d-98eb37a4bed6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Jul 21 17:45:25.596202 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 191/394] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:25 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:26.607024 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d16b1cea-5526-4509-adca-d06034a4349c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:26.607929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d16b1cea-5526-4509-adca-d06034a4349c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:26.610349 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=30 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:45:26.615726 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d16b1cea-5526-4509-adca-d06034a4349c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:26.616174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d16b1cea-5526-4509-adca-d06034a4349c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:26.616973 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d16b1cea-5526-4509-adca-d06034a4349c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:26.617407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d16b1cea-5526-4509-adca-d06034a4349c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:26.621141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=90 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:45:26.647053 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d16b1cea-5526-4509-adca-d06034a4349c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 Jul 21 17:45:26.647596 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 204/395] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:26 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:27.659427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ebfff805-5da7-4523-9df5-f49461986491 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:27.660375 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ebfff805-5da7-4523-9df5-f49461986491 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:27.666774 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebfff805-5da7-4523-9df5-f49461986491 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:27.667224 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebfff805-5da7-4523-9df5-f49461986491 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:27.668017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebfff805-5da7-4523-9df5-f49461986491 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:27.668489 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebfff805-5da7-4523-9df5-f49461986491 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:27.698309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ebfff805-5da7-4523-9df5-f49461986491 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043426 Jul 21 17:45:27.698866 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 192/396] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:27 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:28.709985 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dc9d8fcb-e7e9-46f1-a904-d452d7999a7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:28.710911 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dc9d8fcb-e7e9-46f1-a904-d452d7999a7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:28.717316 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc9d8fcb-e7e9-46f1-a904-d452d7999a7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:28.717765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc9d8fcb-e7e9-46f1-a904-d452d7999a7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:28.718521 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc9d8fcb-e7e9-46f1-a904-d452d7999a7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:28.718953 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc9d8fcb-e7e9-46f1-a904-d452d7999a7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:28.749069 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dc9d8fcb-e7e9-46f1-a904-d452d7999a7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043106 Jul 21 17:45:28.749621 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 205/397] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:28 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:29.760982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a0c5c7ed-cb7b-4add-aac5-6ad99a6a126c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:29.761818 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a0c5c7ed-cb7b-4add-aac5-6ad99a6a126c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:29.768281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a0c5c7ed-cb7b-4add-aac5-6ad99a6a126c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:29.768762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a0c5c7ed-cb7b-4add-aac5-6ad99a6a126c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:29.769534 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a0c5c7ed-cb7b-4add-aac5-6ad99a6a126c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:29.769994 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a0c5c7ed-cb7b-4add-aac5-6ad99a6a126c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:29.798283 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a0c5c7ed-cb7b-4add-aac5-6ad99a6a126c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041305 Jul 21 17:45:29.798819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 193/398] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:29 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:30.810489 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-02934882-5439-4560-af8b-d10822a9e851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:30.811351 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-02934882-5439-4560-af8b-d10822a9e851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:30.818514 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-02934882-5439-4560-af8b-d10822a9e851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:30.818972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-02934882-5439-4560-af8b-d10822a9e851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:30.819735 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-02934882-5439-4560-af8b-d10822a9e851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:30.820180 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-02934882-5439-4560-af8b-d10822a9e851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:30.849101 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-02934882-5439-4560-af8b-d10822a9e851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042677 Jul 21 17:45:30.849639 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 206/399] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:30 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:31.862205 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-19cce547-d320-49a4-8e82-bbd4e2087bff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:31.863058 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-19cce547-d320-49a4-8e82-bbd4e2087bff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:31.869965 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19cce547-d320-49a4-8e82-bbd4e2087bff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:31.870439 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19cce547-d320-49a4-8e82-bbd4e2087bff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:31.871204 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19cce547-d320-49a4-8e82-bbd4e2087bff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:31.871643 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19cce547-d320-49a4-8e82-bbd4e2087bff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:31.902891 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-19cce547-d320-49a4-8e82-bbd4e2087bff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045831 Jul 21 17:45:31.903438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 194/400] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:32.914429 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5291d6e5-c442-4ae1-aacf-b2575facfaff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:32.915428 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5291d6e5-c442-4ae1-aacf-b2575facfaff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:32.922352 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5291d6e5-c442-4ae1-aacf-b2575facfaff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:32.922802 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5291d6e5-c442-4ae1-aacf-b2575facfaff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:32.923567 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5291d6e5-c442-4ae1-aacf-b2575facfaff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:32.924001 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5291d6e5-c442-4ae1-aacf-b2575facfaff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:32.954722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5291d6e5-c442-4ae1-aacf-b2575facfaff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Jul 21 17:45:32.955282 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 207/401] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:32 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:33.965975 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-24d629cc-561f-4cc1-bb3f-f16362ff24e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:33.966909 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-24d629cc-561f-4cc1-bb3f-f16362ff24e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:33.973978 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-24d629cc-561f-4cc1-bb3f-f16362ff24e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:33.974935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-24d629cc-561f-4cc1-bb3f-f16362ff24e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:33.975709 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-24d629cc-561f-4cc1-bb3f-f16362ff24e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:33.976154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-24d629cc-561f-4cc1-bb3f-f16362ff24e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:34.005928 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-24d629cc-561f-4cc1-bb3f-f16362ff24e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043878 Jul 21 17:45:34.006471 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 195/402] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:33 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:35.017333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-24a782ba-ad3a-46fb-b534-303c103b1aff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:35.018264 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-24a782ba-ad3a-46fb-b534-303c103b1aff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:35.024799 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-24a782ba-ad3a-46fb-b534-303c103b1aff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:35.025257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-24a782ba-ad3a-46fb-b534-303c103b1aff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:35.026027 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-24a782ba-ad3a-46fb-b534-303c103b1aff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:35.026469 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-24a782ba-ad3a-46fb-b534-303c103b1aff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:35.055805 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-24a782ba-ad3a-46fb-b534-303c103b1aff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042362 Jul 21 17:45:35.056372 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 208/403] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:35 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:36.067888 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-14891df7-e206-4ffb-93eb-2f0301df586f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:36.068857 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-14891df7-e206-4ffb-93eb-2f0301df586f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:36.075452 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14891df7-e206-4ffb-93eb-2f0301df586f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:36.075901 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14891df7-e206-4ffb-93eb-2f0301df586f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:36.076685 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14891df7-e206-4ffb-93eb-2f0301df586f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:36.077125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14891df7-e206-4ffb-93eb-2f0301df586f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:36.105697 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-14891df7-e206-4ffb-93eb-2f0301df586f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042338 Jul 21 17:45:36.106255 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 196/404] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:36 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:37.118114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-358811bc-2d0d-48c5-bb4b-e2d13003463b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:37.119047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-358811bc-2d0d-48c5-bb4b-e2d13003463b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:37.125682 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-358811bc-2d0d-48c5-bb4b-e2d13003463b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:37.126141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-358811bc-2d0d-48c5-bb4b-e2d13003463b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:37.126908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-358811bc-2d0d-48c5-bb4b-e2d13003463b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:37.127351 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-358811bc-2d0d-48c5-bb4b-e2d13003463b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:37.155913 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-358811bc-2d0d-48c5-bb4b-e2d13003463b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042366 Jul 21 17:45:37.156478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 209/405] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:37 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:38.167706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9544f80d-2da9-4472-948a-f0240b0f467b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:38.168654 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9544f80d-2da9-4472-948a-f0240b0f467b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:38.175056 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9544f80d-2da9-4472-948a-f0240b0f467b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:38.175503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9544f80d-2da9-4472-948a-f0240b0f467b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:38.176260 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9544f80d-2da9-4472-948a-f0240b0f467b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:38.177654 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9544f80d-2da9-4472-948a-f0240b0f467b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:38.207381 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9544f80d-2da9-4472-948a-f0240b0f467b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Jul 21 17:45:38.208091 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 197/406] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:38 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:39.219272 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2cf7a783-b70e-4ea8-9ec0-8371769ec83d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:39.220121 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2cf7a783-b70e-4ea8-9ec0-8371769ec83d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:39.226707 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2cf7a783-b70e-4ea8-9ec0-8371769ec83d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:39.227161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2cf7a783-b70e-4ea8-9ec0-8371769ec83d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:39.227924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2cf7a783-b70e-4ea8-9ec0-8371769ec83d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:39.228387 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2cf7a783-b70e-4ea8-9ec0-8371769ec83d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:39.257122 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2cf7a783-b70e-4ea8-9ec0-8371769ec83d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041849 Jul 21 17:45:39.257665 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 210/407] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:39 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:40.267947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-89783c77-96cc-492b-b3ee-bb8dff23bdc4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:40.268832 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-89783c77-96cc-492b-b3ee-bb8dff23bdc4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:40.275370 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89783c77-96cc-492b-b3ee-bb8dff23bdc4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:40.275819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89783c77-96cc-492b-b3ee-bb8dff23bdc4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:40.276679 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89783c77-96cc-492b-b3ee-bb8dff23bdc4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:40.277112 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89783c77-96cc-492b-b3ee-bb8dff23bdc4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:40.306736 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-89783c77-96cc-492b-b3ee-bb8dff23bdc4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042885 Jul 21 17:45:40.307281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 198/408] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:41.319175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f06762cb-23c7-43a8-9422-1996d446d4af tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:41.320028 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f06762cb-23c7-43a8-9422-1996d446d4af tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:41.326507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f06762cb-23c7-43a8-9422-1996d446d4af tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:41.326966 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f06762cb-23c7-43a8-9422-1996d446d4af tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:41.327738 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f06762cb-23c7-43a8-9422-1996d446d4af tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:41.328182 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f06762cb-23c7-43a8-9422-1996d446d4af tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:41.357694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f06762cb-23c7-43a8-9422-1996d446d4af tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043176 Jul 21 17:45:41.358244 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 211/409] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:41 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:42.369698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-93d8ff68-f9f0-48d9-9fa4-342744ad63c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:42.370652 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-93d8ff68-f9f0-48d9-9fa4-342744ad63c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:42.377021 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-93d8ff68-f9f0-48d9-9fa4-342744ad63c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:42.377467 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-93d8ff68-f9f0-48d9-9fa4-342744ad63c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:42.378222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-93d8ff68-f9f0-48d9-9fa4-342744ad63c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:42.378650 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-93d8ff68-f9f0-48d9-9fa4-342744ad63c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:42.407076 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-93d8ff68-f9f0-48d9-9fa4-342744ad63c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041277 Jul 21 17:45:42.407552 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 199/410] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:42 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:45:43.418422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-11ef2442-2089-4768-9998-51382ed1ca27 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:43.419408 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-11ef2442-2089-4768-9998-51382ed1ca27 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:43.425923 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-11ef2442-2089-4768-9998-51382ed1ca27 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:43.426958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-11ef2442-2089-4768-9998-51382ed1ca27 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:43.427932 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-11ef2442-2089-4768-9998-51382ed1ca27 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:43.428411 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-11ef2442-2089-4768-9998-51382ed1ca27 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:43.458305 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-11ef2442-2089-4768-9998-51382ed1ca27 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043722 Jul 21 17:45:43.458780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 212/411] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:45:44.469729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a82ff23b-6ff0-466d-96e0-0ff65ae55ac1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:44.470582 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a82ff23b-6ff0-466d-96e0-0ff65ae55ac1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:44.477078 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a82ff23b-6ff0-466d-96e0-0ff65ae55ac1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:44.477522 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a82ff23b-6ff0-466d-96e0-0ff65ae55ac1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:44.478278 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a82ff23b-6ff0-466d-96e0-0ff65ae55ac1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:44.478711 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a82ff23b-6ff0-466d-96e0-0ff65ae55ac1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:44.506880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a82ff23b-6ff0-466d-96e0-0ff65ae55ac1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041093 Jul 21 17:45:44.507421 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 200/412] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:44 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:45.518343 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e57eb9a1-2d08-4298-ae1a-45ac527772ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:45.519191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e57eb9a1-2d08-4298-ae1a-45ac527772ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:45.525805 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e57eb9a1-2d08-4298-ae1a-45ac527772ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:45.526258 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e57eb9a1-2d08-4298-ae1a-45ac527772ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:45.527023 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e57eb9a1-2d08-4298-ae1a-45ac527772ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:45.527463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e57eb9a1-2d08-4298-ae1a-45ac527772ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:45.556913 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e57eb9a1-2d08-4298-ae1a-45ac527772ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042524 Jul 21 17:45:45.557469 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 213/413] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:45 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:46.569190 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0834f7bb-5d00-4fb8-bdcb-0060cec617db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:46.570078 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0834f7bb-5d00-4fb8-bdcb-0060cec617db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:46.576610 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0834f7bb-5d00-4fb8-bdcb-0060cec617db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:46.577057 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0834f7bb-5d00-4fb8-bdcb-0060cec617db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:46.577814 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0834f7bb-5d00-4fb8-bdcb-0060cec617db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:46.578244 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0834f7bb-5d00-4fb8-bdcb-0060cec617db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:46.607108 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0834f7bb-5d00-4fb8-bdcb-0060cec617db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Jul 21 17:45:46.607647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 201/414] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:46 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:47.619198 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e81ec85c-2285-4cc6-bf89-d153a89ee878 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:47.620174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e81ec85c-2285-4cc6-bf89-d153a89ee878 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:47.626773 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e81ec85c-2285-4cc6-bf89-d153a89ee878 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:47.627230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e81ec85c-2285-4cc6-bf89-d153a89ee878 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:47.628000 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e81ec85c-2285-4cc6-bf89-d153a89ee878 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:47.628485 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e81ec85c-2285-4cc6-bf89-d153a89ee878 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:47.657041 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e81ec85c-2285-4cc6-bf89-d153a89ee878 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042497 Jul 21 17:45:47.657586 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 214/415] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:48.669126 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0f1701ca-561e-46a5-ad3e-cd44b05c1238 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:48.670055 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0f1701ca-561e-46a5-ad3e-cd44b05c1238 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:48.676466 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f1701ca-561e-46a5-ad3e-cd44b05c1238 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:48.676917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f1701ca-561e-46a5-ad3e-cd44b05c1238 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:48.677681 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f1701ca-561e-46a5-ad3e-cd44b05c1238 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:48.678204 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f1701ca-561e-46a5-ad3e-cd44b05c1238 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:48.706315 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0f1701ca-561e-46a5-ad3e-cd44b05c1238 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041115 Jul 21 17:45:48.706846 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 202/416] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:48 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:45:49.718323 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-06268a62-3136-4bb1-8509-af1d95e2e114 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:49.719175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-06268a62-3136-4bb1-8509-af1d95e2e114 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:49.726298 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-06268a62-3136-4bb1-8509-af1d95e2e114 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:49.726750 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-06268a62-3136-4bb1-8509-af1d95e2e114 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:49.727513 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-06268a62-3136-4bb1-8509-af1d95e2e114 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:49.727956 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-06268a62-3136-4bb1-8509-af1d95e2e114 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:49.758270 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-06268a62-3136-4bb1-8509-af1d95e2e114 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 Jul 21 17:45:49.758826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 215/417] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:49 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:50.770581 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f0a10bd1-4a14-4b62-ba21-c27ba5e5baa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:50.772024 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f0a10bd1-4a14-4b62-ba21-c27ba5e5baa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:50.778551 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0a10bd1-4a14-4b62-ba21-c27ba5e5baa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:50.779003 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0a10bd1-4a14-4b62-ba21-c27ba5e5baa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:50.779756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0a10bd1-4a14-4b62-ba21-c27ba5e5baa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:50.780190 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0a10bd1-4a14-4b62-ba21-c27ba5e5baa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:50.809553 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f0a10bd1-4a14-4b62-ba21-c27ba5e5baa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Jul 21 17:45:50.810037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 203/418] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:50 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:51.821269 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-067e7efe-2b66-4d38-80b9-7f08e4fb4cd6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:51.822205 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-067e7efe-2b66-4d38-80b9-7f08e4fb4cd6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:51.828805 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-067e7efe-2b66-4d38-80b9-7f08e4fb4cd6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:51.829251 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-067e7efe-2b66-4d38-80b9-7f08e4fb4cd6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:51.830012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-067e7efe-2b66-4d38-80b9-7f08e4fb4cd6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:51.830445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-067e7efe-2b66-4d38-80b9-7f08e4fb4cd6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:51.859558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-067e7efe-2b66-4d38-80b9-7f08e4fb4cd6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042350 Jul 21 17:45:51.860096 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 216/419] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:52.871808 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5a678891-ac75-4f57-8b99-239908fedef9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:52.872773 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5a678891-ac75-4f57-8b99-239908fedef9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:52.879155 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a678891-ac75-4f57-8b99-239908fedef9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:52.879600 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a678891-ac75-4f57-8b99-239908fedef9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:52.880406 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a678891-ac75-4f57-8b99-239908fedef9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:52.881616 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a678891-ac75-4f57-8b99-239908fedef9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:52.909353 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5a678891-ac75-4f57-8b99-239908fedef9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041509 Jul 21 17:45:52.909888 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 204/420] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:52 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:53.921802 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4929c030-00ee-4aa2-a69e-507304b16123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:53.922716 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4929c030-00ee-4aa2-a69e-507304b16123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:53.929329 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4929c030-00ee-4aa2-a69e-507304b16123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:53.929791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4929c030-00ee-4aa2-a69e-507304b16123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:53.930560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4929c030-00ee-4aa2-a69e-507304b16123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:53.930999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4929c030-00ee-4aa2-a69e-507304b16123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:53.961280 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4929c030-00ee-4aa2-a69e-507304b16123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043884 Jul 21 17:45:53.961832 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 217/421] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:53 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:54.973046 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a0cb099-81c2-4112-879a-612a2a6f4081 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:54.973955 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4a0cb099-81c2-4112-879a-612a2a6f4081 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:54.980964 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a0cb099-81c2-4112-879a-612a2a6f4081 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:54.981417 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a0cb099-81c2-4112-879a-612a2a6f4081 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:54.982182 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a0cb099-81c2-4112-879a-612a2a6f4081 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:54.982622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a0cb099-81c2-4112-879a-612a2a6f4081 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:55.012260 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4a0cb099-81c2-4112-879a-612a2a6f4081 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043316 Jul 21 17:45:55.012863 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 205/422] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:54 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:56.023210 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bef97a00-ce73-40ce-88c4-14d12721a851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:56.024078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bef97a00-ce73-40ce-88c4-14d12721a851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:56.030555 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bef97a00-ce73-40ce-88c4-14d12721a851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:56.031004 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bef97a00-ce73-40ce-88c4-14d12721a851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:56.031759 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bef97a00-ce73-40ce-88c4-14d12721a851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:56.032195 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bef97a00-ce73-40ce-88c4-14d12721a851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:56.061815 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bef97a00-ce73-40ce-88c4-14d12721a851 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042654 Jul 21 17:45:56.062369 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 218/423] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:56 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:57.074384 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f3809bbf-4006-45ae-b2f6-7c88622f70e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:57.075233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f3809bbf-4006-45ae-b2f6-7c88622f70e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:57.077732 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=30 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:45:57.083003 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3809bbf-4006-45ae-b2f6-7c88622f70e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:57.083452 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3809bbf-4006-45ae-b2f6-7c88622f70e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:57.084867 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3809bbf-4006-45ae-b2f6-7c88622f70e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:57.085304 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3809bbf-4006-45ae-b2f6-7c88622f70e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:57.089020 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=90 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:45:57.113623 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f3809bbf-4006-45ae-b2f6-7c88622f70e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043237 Jul 21 17:45:57.114164 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 206/424] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:57 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:58.124924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-068a61d9-36a4-41a7-9f73-0c1e059733ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:58.125854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-068a61d9-36a4-41a7-9f73-0c1e059733ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:58.128256 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=30 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:45:58.133860 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-068a61d9-36a4-41a7-9f73-0c1e059733ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:58.134314 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-068a61d9-36a4-41a7-9f73-0c1e059733ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:58.135123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-068a61d9-36a4-41a7-9f73-0c1e059733ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:58.135568 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-068a61d9-36a4-41a7-9f73-0c1e059733ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:58.139341 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=90 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:45:58.165711 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-068a61d9-36a4-41a7-9f73-0c1e059733ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044726 Jul 21 17:45:58.166267 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 219/425] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:58 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:45:59.177122 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2ea6efa5-c7cb-458b-827c-41ee555fbd40 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:45:59.178515 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2ea6efa5-c7cb-458b-827c-41ee555fbd40 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:45:59.184943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ea6efa5-c7cb-458b-827c-41ee555fbd40 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:59.185388 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ea6efa5-c7cb-458b-827c-41ee555fbd40 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:59.186142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ea6efa5-c7cb-458b-827c-41ee555fbd40 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:45:59.186573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ea6efa5-c7cb-458b-827c-41ee555fbd40 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:45:59.215594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2ea6efa5-c7cb-458b-827c-41ee555fbd40 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042474 Jul 21 17:45:59.216145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 207/426] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:45:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:00.226738 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-156e3125-1497-45a0-a250-4228f3f0c0a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:00.227608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-156e3125-1497-45a0-a250-4228f3f0c0a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:00.234193 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-156e3125-1497-45a0-a250-4228f3f0c0a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:00.234640 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-156e3125-1497-45a0-a250-4228f3f0c0a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:00.235394 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-156e3125-1497-45a0-a250-4228f3f0c0a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:00.235827 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-156e3125-1497-45a0-a250-4228f3f0c0a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:00.264328 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-156e3125-1497-45a0-a250-4228f3f0c0a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041618 Jul 21 17:46:00.264869 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 220/427] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:01.275860 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-39aa2e98-70a9-4f5a-947f-c23a04e1fbde tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:01.276838 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-39aa2e98-70a9-4f5a-947f-c23a04e1fbde tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:01.282916 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39aa2e98-70a9-4f5a-947f-c23a04e1fbde tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:01.283305 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39aa2e98-70a9-4f5a-947f-c23a04e1fbde tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:01.284062 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39aa2e98-70a9-4f5a-947f-c23a04e1fbde tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:01.284535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39aa2e98-70a9-4f5a-947f-c23a04e1fbde tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:01.313942 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-39aa2e98-70a9-4f5a-947f-c23a04e1fbde tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042906 Jul 21 17:46:01.314526 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 208/428] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:01 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:02.325497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fe005888-6cb0-4683-af8c-45dd488300e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:02.326561 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fe005888-6cb0-4683-af8c-45dd488300e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:02.332564 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fe005888-6cb0-4683-af8c-45dd488300e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:02.333016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fe005888-6cb0-4683-af8c-45dd488300e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:02.333778 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fe005888-6cb0-4683-af8c-45dd488300e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:02.334289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fe005888-6cb0-4683-af8c-45dd488300e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:02.362760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fe005888-6cb0-4683-af8c-45dd488300e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041367 Jul 21 17:46:02.363295 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 221/429] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:03.374989 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9665a57e-4844-4700-8b3d-4aa37189b442 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:03.375919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9665a57e-4844-4700-8b3d-4aa37189b442 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:03.383081 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9665a57e-4844-4700-8b3d-4aa37189b442 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:03.383538 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9665a57e-4844-4700-8b3d-4aa37189b442 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:03.384337 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9665a57e-4844-4700-8b3d-4aa37189b442 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:03.384785 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9665a57e-4844-4700-8b3d-4aa37189b442 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:03.412930 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9665a57e-4844-4700-8b3d-4aa37189b442 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041866 Jul 21 17:46:03.413537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 209/430] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:03 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:04.424479 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-25feffa5-b875-40ef-94aa-0e27ec58b0ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:04.425524 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-25feffa5-b875-40ef-94aa-0e27ec58b0ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:04.432608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25feffa5-b875-40ef-94aa-0e27ec58b0ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:04.433061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25feffa5-b875-40ef-94aa-0e27ec58b0ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:04.433823 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25feffa5-b875-40ef-94aa-0e27ec58b0ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:04.434263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25feffa5-b875-40ef-94aa-0e27ec58b0ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:04.463560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-25feffa5-b875-40ef-94aa-0e27ec58b0ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 Jul 21 17:46:04.464044 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 222/431] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:04 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:05.474280 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-441e2519-f33e-4373-8cef-acc76939562e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:05.475195 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-441e2519-f33e-4373-8cef-acc76939562e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:05.481759 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-441e2519-f33e-4373-8cef-acc76939562e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:05.482202 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-441e2519-f33e-4373-8cef-acc76939562e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:05.482983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-441e2519-f33e-4373-8cef-acc76939562e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:05.483416 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-441e2519-f33e-4373-8cef-acc76939562e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:05.512076 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-441e2519-f33e-4373-8cef-acc76939562e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041608 Jul 21 17:46:05.512602 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 210/432] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:06.523814 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a27c5004-4b1c-42c7-befe-d51b83ca0565 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:06.524888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a27c5004-4b1c-42c7-befe-d51b83ca0565 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:06.531294 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a27c5004-4b1c-42c7-befe-d51b83ca0565 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:06.531740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a27c5004-4b1c-42c7-befe-d51b83ca0565 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:06.532530 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a27c5004-4b1c-42c7-befe-d51b83ca0565 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:06.532965 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a27c5004-4b1c-42c7-befe-d51b83ca0565 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:06.562656 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a27c5004-4b1c-42c7-befe-d51b83ca0565 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043122 Jul 21 17:46:06.563383 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 223/433] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:06 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:07.574550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c2ad1c71-7cfc-4ea4-8b4e-6ca9613e157c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:07.575482 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c2ad1c71-7cfc-4ea4-8b4e-6ca9613e157c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:07.582221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c2ad1c71-7cfc-4ea4-8b4e-6ca9613e157c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:07.582674 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c2ad1c71-7cfc-4ea4-8b4e-6ca9613e157c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:07.583447 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c2ad1c71-7cfc-4ea4-8b4e-6ca9613e157c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:07.583895 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c2ad1c71-7cfc-4ea4-8b4e-6ca9613e157c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:07.613744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c2ad1c71-7cfc-4ea4-8b4e-6ca9613e157c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042967 Jul 21 17:46:07.614042 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 211/434] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:07 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:08.625568 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-56760983-5e03-452d-a444-6cd251764c15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:08.626481 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-56760983-5e03-452d-a444-6cd251764c15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:08.633335 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56760983-5e03-452d-a444-6cd251764c15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:08.633716 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56760983-5e03-452d-a444-6cd251764c15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:08.634475 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56760983-5e03-452d-a444-6cd251764c15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:08.634906 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56760983-5e03-452d-a444-6cd251764c15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:08.665011 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-56760983-5e03-452d-a444-6cd251764c15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 Jul 21 17:46:08.665575 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 224/435] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:46:09.676402 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-720c8b9a-9bc0-4dd8-8e3c-1095213a703a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:09.677325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-720c8b9a-9bc0-4dd8-8e3c-1095213a703a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:09.684016 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-720c8b9a-9bc0-4dd8-8e3c-1095213a703a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:09.684500 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-720c8b9a-9bc0-4dd8-8e3c-1095213a703a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:09.685258 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-720c8b9a-9bc0-4dd8-8e3c-1095213a703a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:09.685692 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-720c8b9a-9bc0-4dd8-8e3c-1095213a703a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:09.717839 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-720c8b9a-9bc0-4dd8-8e3c-1095213a703a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 Jul 21 17:46:09.718387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 212/436] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:10.729307 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-87d84c28-6650-4b3f-aa3f-bece684db8a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:10.730227 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-87d84c28-6650-4b3f-aa3f-bece684db8a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:10.736661 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-87d84c28-6650-4b3f-aa3f-bece684db8a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:10.737111 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-87d84c28-6650-4b3f-aa3f-bece684db8a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:10.737870 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-87d84c28-6650-4b3f-aa3f-bece684db8a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:10.738305 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-87d84c28-6650-4b3f-aa3f-bece684db8a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:10.768336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-87d84c28-6650-4b3f-aa3f-bece684db8a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 Jul 21 17:46:10.768336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 225/437] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:10 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:11.778729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6b94ee93-bf61-4dc0-be38-8b25160f9998 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:11.779685 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6b94ee93-bf61-4dc0-be38-8b25160f9998 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:11.786147 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b94ee93-bf61-4dc0-be38-8b25160f9998 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:11.786603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b94ee93-bf61-4dc0-be38-8b25160f9998 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:11.787406 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b94ee93-bf61-4dc0-be38-8b25160f9998 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:11.787850 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b94ee93-bf61-4dc0-be38-8b25160f9998 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:11.817852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6b94ee93-bf61-4dc0-be38-8b25160f9998 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043055 Jul 21 17:46:11.818400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 213/438] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:11 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:12.829702 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cd765f40-26f1-4096-8104-eef76b4c7785 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:12.830620 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cd765f40-26f1-4096-8104-eef76b4c7785 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:12.837605 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cd765f40-26f1-4096-8104-eef76b4c7785 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:12.838046 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cd765f40-26f1-4096-8104-eef76b4c7785 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:12.838796 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cd765f40-26f1-4096-8104-eef76b4c7785 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:12.839231 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cd765f40-26f1-4096-8104-eef76b4c7785 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:12.867119 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cd765f40-26f1-4096-8104-eef76b4c7785 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041255 Jul 21 17:46:12.867686 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 226/439] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:12 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:13.878339 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-28886e3b-8a45-4dea-9544-68705e6ce19f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:13.879314 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-28886e3b-8a45-4dea-9544-68705e6ce19f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:13.886188 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-28886e3b-8a45-4dea-9544-68705e6ce19f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:13.886631 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-28886e3b-8a45-4dea-9544-68705e6ce19f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:13.887418 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-28886e3b-8a45-4dea-9544-68705e6ce19f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:13.887851 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-28886e3b-8a45-4dea-9544-68705e6ce19f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:13.919268 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-28886e3b-8a45-4dea-9544-68705e6ce19f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044950 Jul 21 17:46:13.919836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 214/440] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:14.931418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fe4faab6-9fbd-4f45-b147-ba42025cf376 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:14.932389 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fe4faab6-9fbd-4f45-b147-ba42025cf376 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:14.939157 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fe4faab6-9fbd-4f45-b147-ba42025cf376 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:14.939605 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fe4faab6-9fbd-4f45-b147-ba42025cf376 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:14.940398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fe4faab6-9fbd-4f45-b147-ba42025cf376 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:14.940836 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fe4faab6-9fbd-4f45-b147-ba42025cf376 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:14.968947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fe4faab6-9fbd-4f45-b147-ba42025cf376 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042267 Jul 21 17:46:14.969490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 227/441] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:14 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:15.980974 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-141b2009-bc16-4c6e-81a6-d24978c3e91f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:15.982088 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-141b2009-bc16-4c6e-81a6-d24978c3e91f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:15.989274 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-141b2009-bc16-4c6e-81a6-d24978c3e91f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:15.989735 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-141b2009-bc16-4c6e-81a6-d24978c3e91f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:15.990535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-141b2009-bc16-4c6e-81a6-d24978c3e91f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:15.990982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-141b2009-bc16-4c6e-81a6-d24978c3e91f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:16.025795 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-141b2009-bc16-4c6e-81a6-d24978c3e91f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049039 Jul 21 17:46:16.026492 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 215/442] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:17.037409 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1aa5e9b3-9353-4e76-a1e7-52941fa76a56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:17.038362 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1aa5e9b3-9353-4e76-a1e7-52941fa76a56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:17.045627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1aa5e9b3-9353-4e76-a1e7-52941fa76a56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:17.046074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1aa5e9b3-9353-4e76-a1e7-52941fa76a56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:17.046838 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1aa5e9b3-9353-4e76-a1e7-52941fa76a56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:17.047273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1aa5e9b3-9353-4e76-a1e7-52941fa76a56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:17.075525 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1aa5e9b3-9353-4e76-a1e7-52941fa76a56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042068 Jul 21 17:46:17.076063 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 228/443] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:17 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:18.086886 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-350634c0-66cf-46b2-8bf1-b05dbf3087e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:18.087830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-350634c0-66cf-46b2-8bf1-b05dbf3087e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:18.094309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-350634c0-66cf-46b2-8bf1-b05dbf3087e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:18.094760 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-350634c0-66cf-46b2-8bf1-b05dbf3087e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:18.095516 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-350634c0-66cf-46b2-8bf1-b05dbf3087e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:18.095952 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-350634c0-66cf-46b2-8bf1-b05dbf3087e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:18.124903 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-350634c0-66cf-46b2-8bf1-b05dbf3087e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041942 Jul 21 17:46:18.125447 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 216/444] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:18 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:19.136988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b926f540-9026-498a-b7ed-afc378116f68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:19.137902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b926f540-9026-498a-b7ed-afc378116f68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:19.144511 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b926f540-9026-498a-b7ed-afc378116f68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:19.144970 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b926f540-9026-498a-b7ed-afc378116f68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:19.145725 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b926f540-9026-498a-b7ed-afc378116f68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:19.146157 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b926f540-9026-498a-b7ed-afc378116f68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:19.174079 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b926f540-9026-498a-b7ed-afc378116f68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041709 Jul 21 17:46:19.174615 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 229/445] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:19 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:20.185300 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-05b50b08-93eb-41a9-83fe-ea1613101f93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:20.186227 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-05b50b08-93eb-41a9-83fe-ea1613101f93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:20.193053 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05b50b08-93eb-41a9-83fe-ea1613101f93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:20.193501 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05b50b08-93eb-41a9-83fe-ea1613101f93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:20.194279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05b50b08-93eb-41a9-83fe-ea1613101f93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:20.194699 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05b50b08-93eb-41a9-83fe-ea1613101f93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:20.222889 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-05b50b08-93eb-41a9-83fe-ea1613101f93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041479 Jul 21 17:46:20.223432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 217/446] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:20 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:21.235144 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c29af272-4ec6-4a20-8fae-57a176b2bea3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:21.236007 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c29af272-4ec6-4a20-8fae-57a176b2bea3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:21.242531 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c29af272-4ec6-4a20-8fae-57a176b2bea3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:21.243072 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c29af272-4ec6-4a20-8fae-57a176b2bea3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:21.243839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c29af272-4ec6-4a20-8fae-57a176b2bea3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:21.244307 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c29af272-4ec6-4a20-8fae-57a176b2bea3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:21.272494 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c29af272-4ec6-4a20-8fae-57a176b2bea3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041384 Jul 21 17:46:21.273033 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 230/447] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:22.284427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a5919a0c-61b0-4ad5-be77-ed086a7a2e6a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:22.285379 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a5919a0c-61b0-4ad5-be77-ed086a7a2e6a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:22.292523 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a5919a0c-61b0-4ad5-be77-ed086a7a2e6a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:22.292972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a5919a0c-61b0-4ad5-be77-ed086a7a2e6a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:22.293727 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a5919a0c-61b0-4ad5-be77-ed086a7a2e6a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:22.294163 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a5919a0c-61b0-4ad5-be77-ed086a7a2e6a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:22.322817 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a5919a0c-61b0-4ad5-be77-ed086a7a2e6a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042340 Jul 21 17:46:22.323359 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 218/448] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:22 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:23.334171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2e048465-8908-489f-8685-15f79774f31c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:23.335104 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2e048465-8908-489f-8685-15f79774f31c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:23.341931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e048465-8908-489f-8685-15f79774f31c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:23.342387 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e048465-8908-489f-8685-15f79774f31c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:23.343157 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e048465-8908-489f-8685-15f79774f31c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:23.343600 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e048465-8908-489f-8685-15f79774f31c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:23.373389 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2e048465-8908-489f-8685-15f79774f31c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Jul 21 17:46:23.373942 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 231/449] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:23 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:24.385650 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-986d40a3-03a3-4ff2-bb3e-f5f0df7f9a5e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:24.386618 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-986d40a3-03a3-4ff2-bb3e-f5f0df7f9a5e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:24.393127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-986d40a3-03a3-4ff2-bb3e-f5f0df7f9a5e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:24.393583 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-986d40a3-03a3-4ff2-bb3e-f5f0df7f9a5e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:24.394361 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-986d40a3-03a3-4ff2-bb3e-f5f0df7f9a5e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:24.394807 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-986d40a3-03a3-4ff2-bb3e-f5f0df7f9a5e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:24.422838 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-986d40a3-03a3-4ff2-bb3e-f5f0df7f9a5e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041874 Jul 21 17:46:24.423386 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 219/450] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:24 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:25.434454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bfe7b2fd-aed9-4fa3-8afb-5d86ed9621d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:25.435412 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bfe7b2fd-aed9-4fa3-8afb-5d86ed9621d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:25.442170 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bfe7b2fd-aed9-4fa3-8afb-5d86ed9621d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:25.442627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bfe7b2fd-aed9-4fa3-8afb-5d86ed9621d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:25.443397 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bfe7b2fd-aed9-4fa3-8afb-5d86ed9621d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:25.443838 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bfe7b2fd-aed9-4fa3-8afb-5d86ed9621d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:25.472974 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bfe7b2fd-aed9-4fa3-8afb-5d86ed9621d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042604 Jul 21 17:46:25.473516 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 232/451] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:25 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:26.484428 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fa60c8e1-4419-4281-97c8-536eeeeba498 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:26.485289 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fa60c8e1-4419-4281-97c8-536eeeeba498 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:26.491660 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa60c8e1-4419-4281-97c8-536eeeeba498 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:26.492130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa60c8e1-4419-4281-97c8-536eeeeba498 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:26.493766 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa60c8e1-4419-4281-97c8-536eeeeba498 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:26.494202 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa60c8e1-4419-4281-97c8-536eeeeba498 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:26.522093 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fa60c8e1-4419-4281-97c8-536eeeeba498 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041623 Jul 21 17:46:26.522635 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 220/452] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:26 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:27.534225 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-892eaff5-05eb-41ac-a3d5-3f90dd7988db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:27.535189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-892eaff5-05eb-41ac-a3d5-3f90dd7988db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:27.541663 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-892eaff5-05eb-41ac-a3d5-3f90dd7988db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:27.542124 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-892eaff5-05eb-41ac-a3d5-3f90dd7988db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:27.542895 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-892eaff5-05eb-41ac-a3d5-3f90dd7988db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:27.543349 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-892eaff5-05eb-41ac-a3d5-3f90dd7988db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:27.572950 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-892eaff5-05eb-41ac-a3d5-3f90dd7988db tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042675 Jul 21 17:46:27.573516 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 233/453] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:27 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:28.583905 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8f10b725-fa73-429f-9878-2d83ebf6d48e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:28.584832 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8f10b725-fa73-429f-9878-2d83ebf6d48e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:28.588145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=30 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:46:28.593744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8f10b725-fa73-429f-9878-2d83ebf6d48e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:28.594193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8f10b725-fa73-429f-9878-2d83ebf6d48e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:28.594954 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8f10b725-fa73-429f-9878-2d83ebf6d48e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:28.595394 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8f10b725-fa73-429f-9878-2d83ebf6d48e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:28.599167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=90 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:46:28.624472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8f10b725-fa73-429f-9878-2d83ebf6d48e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Jul 21 17:46:28.624995 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 221/454] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:28 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:29.635049 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7fa65921-32eb-4979-8317-cfe0b6f3e7d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:29.635988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7fa65921-32eb-4979-8317-cfe0b6f3e7d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:29.638499 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=30 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:46:29.643986 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fa65921-32eb-4979-8317-cfe0b6f3e7d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:29.644477 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fa65921-32eb-4979-8317-cfe0b6f3e7d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:29.645252 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fa65921-32eb-4979-8317-cfe0b6f3e7d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:29.645702 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fa65921-32eb-4979-8317-cfe0b6f3e7d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:29.649946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=90 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:46:29.675855 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7fa65921-32eb-4979-8317-cfe0b6f3e7d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Jul 21 17:46:29.676443 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 234/455] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:29 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:30.687000 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a6e540bd-5f25-4307-949f-f22f965b531c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:30.687922 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a6e540bd-5f25-4307-949f-f22f965b531c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:30.694590 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6e540bd-5f25-4307-949f-f22f965b531c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:30.695036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6e540bd-5f25-4307-949f-f22f965b531c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:30.696014 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6e540bd-5f25-4307-949f-f22f965b531c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:30.696481 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6e540bd-5f25-4307-949f-f22f965b531c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:30.725118 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a6e540bd-5f25-4307-949f-f22f965b531c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041933 Jul 21 17:46:30.725694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 222/456] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:30 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:31.737077 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e48ffd27-f934-4662-9902-6102a338ff33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:31.738003 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e48ffd27-f934-4662-9902-6102a338ff33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:31.744317 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e48ffd27-f934-4662-9902-6102a338ff33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:31.744772 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e48ffd27-f934-4662-9902-6102a338ff33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:31.745534 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e48ffd27-f934-4662-9902-6102a338ff33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:31.745971 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e48ffd27-f934-4662-9902-6102a338ff33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:31.776338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e48ffd27-f934-4662-9902-6102a338ff33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043262 Jul 21 17:46:31.776912 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 235/457] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:32.787674 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b937ca01-2a77-470f-a37a-b2d8f683956f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:32.788641 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b937ca01-2a77-470f-a37a-b2d8f683956f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:32.795206 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b937ca01-2a77-470f-a37a-b2d8f683956f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:32.795671 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b937ca01-2a77-470f-a37a-b2d8f683956f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:32.796469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b937ca01-2a77-470f-a37a-b2d8f683956f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:32.796917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b937ca01-2a77-470f-a37a-b2d8f683956f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:32.826134 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b937ca01-2a77-470f-a37a-b2d8f683956f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042483 Jul 21 17:46:32.826699 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 223/458] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:32 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:33.837727 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d72835c9-3ccc-4b9f-8849-613dc5d4ac33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:33.838658 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d72835c9-3ccc-4b9f-8849-613dc5d4ac33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:33.845153 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d72835c9-3ccc-4b9f-8849-613dc5d4ac33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:33.845610 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d72835c9-3ccc-4b9f-8849-613dc5d4ac33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:33.846382 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d72835c9-3ccc-4b9f-8849-613dc5d4ac33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:33.846822 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d72835c9-3ccc-4b9f-8849-613dc5d4ac33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:33.879429 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d72835c9-3ccc-4b9f-8849-613dc5d4ac33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045261 Jul 21 17:46:33.880368 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 236/459] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:33 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:34.890819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-20673fb0-82e3-4456-9636-f97853ba91d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:34.891754 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-20673fb0-82e3-4456-9636-f97853ba91d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:34.898193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20673fb0-82e3-4456-9636-f97853ba91d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:34.898690 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20673fb0-82e3-4456-9636-f97853ba91d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:34.899463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20673fb0-82e3-4456-9636-f97853ba91d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:34.899908 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20673fb0-82e3-4456-9636-f97853ba91d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:34.929037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-20673fb0-82e3-4456-9636-f97853ba91d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042023 Jul 21 17:46:34.930405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 224/460] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:34 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:35.941452 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4f5cccf9-0c0e-4f7c-a06a-b38a723d5bcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:35.942441 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4f5cccf9-0c0e-4f7c-a06a-b38a723d5bcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:35.948937 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4f5cccf9-0c0e-4f7c-a06a-b38a723d5bcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:35.949382 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4f5cccf9-0c0e-4f7c-a06a-b38a723d5bcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:35.950134 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4f5cccf9-0c0e-4f7c-a06a-b38a723d5bcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:35.950568 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4f5cccf9-0c0e-4f7c-a06a-b38a723d5bcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:35.980254 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4f5cccf9-0c0e-4f7c-a06a-b38a723d5bcc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043080 Jul 21 17:46:35.981088 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 237/461] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:35 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:36.990955 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-374a58f1-00b0-44d0-a9d9-ec5c03c4e9d8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:36.991874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-374a58f1-00b0-44d0-a9d9-ec5c03c4e9d8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:36.998836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-374a58f1-00b0-44d0-a9d9-ec5c03c4e9d8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:36.999281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-374a58f1-00b0-44d0-a9d9-ec5c03c4e9d8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:37.000046 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-374a58f1-00b0-44d0-a9d9-ec5c03c4e9d8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:37.000516 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-374a58f1-00b0-44d0-a9d9-ec5c03c4e9d8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:37.029775 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-374a58f1-00b0-44d0-a9d9-ec5c03c4e9d8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042671 Jul 21 17:46:37.030329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 225/462] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:36 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:38.041687 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-36c84595-454e-47d7-8159-ff2d9b1a55bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:38.042624 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-36c84595-454e-47d7-8159-ff2d9b1a55bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:38.048802 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-36c84595-454e-47d7-8159-ff2d9b1a55bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:38.049257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-36c84595-454e-47d7-8159-ff2d9b1a55bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:38.050112 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-36c84595-454e-47d7-8159-ff2d9b1a55bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:38.050559 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-36c84595-454e-47d7-8159-ff2d9b1a55bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:38.080753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-36c84595-454e-47d7-8159-ff2d9b1a55bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043464 Jul 21 17:46:38.081324 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 238/463] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:38 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:39.092907 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9ed8e875-8e82-4fa4-a61c-bf698953d934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:39.093862 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9ed8e875-8e82-4fa4-a61c-bf698953d934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:39.100440 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ed8e875-8e82-4fa4-a61c-bf698953d934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:39.100885 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ed8e875-8e82-4fa4-a61c-bf698953d934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:39.101647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ed8e875-8e82-4fa4-a61c-bf698953d934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:39.102077 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ed8e875-8e82-4fa4-a61c-bf698953d934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:39.131959 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9ed8e875-8e82-4fa4-a61c-bf698953d934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042978 Jul 21 17:46:39.132741 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 226/464] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:39 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:46:40.144553 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b8f3e5f5-cc13-4482-ab5d-23bc3c990c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:40.145483 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b8f3e5f5-cc13-4482-ab5d-23bc3c990c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:40.152659 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b8f3e5f5-cc13-4482-ab5d-23bc3c990c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:40.153137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b8f3e5f5-cc13-4482-ab5d-23bc3c990c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:40.153861 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b8f3e5f5-cc13-4482-ab5d-23bc3c990c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:40.154292 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b8f3e5f5-cc13-4482-ab5d-23bc3c990c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:40.183553 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b8f3e5f5-cc13-4482-ab5d-23bc3c990c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043241 Jul 21 17:46:40.184112 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 239/465] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:41.195133 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9f0c9fda-ffe6-4259-b8a5-3e97b2e47a67 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:41.196093 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9f0c9fda-ffe6-4259-b8a5-3e97b2e47a67 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:41.203220 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f0c9fda-ffe6-4259-b8a5-3e97b2e47a67 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:41.203750 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f0c9fda-ffe6-4259-b8a5-3e97b2e47a67 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:41.204656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f0c9fda-ffe6-4259-b8a5-3e97b2e47a67 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:41.205164 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f0c9fda-ffe6-4259-b8a5-3e97b2e47a67 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:41.236781 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9f0c9fda-ffe6-4259-b8a5-3e97b2e47a67 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045553 Jul 21 17:46:41.237342 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 227/466] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:41 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:42.248841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-259fbb13-a7ca-4548-93c7-1386f48ab41e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:42.249798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-259fbb13-a7ca-4548-93c7-1386f48ab41e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:42.256219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-259fbb13-a7ca-4548-93c7-1386f48ab41e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:42.256708 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-259fbb13-a7ca-4548-93c7-1386f48ab41e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:42.257480 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-259fbb13-a7ca-4548-93c7-1386f48ab41e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:42.257921 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-259fbb13-a7ca-4548-93c7-1386f48ab41e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:42.287668 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-259fbb13-a7ca-4548-93c7-1386f48ab41e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042841 Jul 21 17:46:42.288208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 240/467] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:42 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:43.298932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8d8ba211-b63a-4a91-9bce-f1be174c7732 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:43.299851 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8d8ba211-b63a-4a91-9bce-f1be174c7732 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:43.306635 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d8ba211-b63a-4a91-9bce-f1be174c7732 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:43.307089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d8ba211-b63a-4a91-9bce-f1be174c7732 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:43.307857 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d8ba211-b63a-4a91-9bce-f1be174c7732 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:43.308318 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d8ba211-b63a-4a91-9bce-f1be174c7732 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:43.340828 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8d8ba211-b63a-4a91-9bce-f1be174c7732 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045704 Jul 21 17:46:43.344539 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 228/468] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:44.352243 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3a65ceeb-13b5-44b0-9647-b71e9fae546d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:44.354007 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3a65ceeb-13b5-44b0-9647-b71e9fae546d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:44.360578 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a65ceeb-13b5-44b0-9647-b71e9fae546d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:44.361030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a65ceeb-13b5-44b0-9647-b71e9fae546d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:44.361799 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a65ceeb-13b5-44b0-9647-b71e9fae546d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:44.362238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a65ceeb-13b5-44b0-9647-b71e9fae546d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:44.391992 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3a65ceeb-13b5-44b0-9647-b71e9fae546d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043928 Jul 21 17:46:44.393732 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 241/469] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:44 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:45.404546 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f6f4776e-85ca-4acc-bfdc-acdc4151deca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:45.405500 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f6f4776e-85ca-4acc-bfdc-acdc4151deca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:45.412180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6f4776e-85ca-4acc-bfdc-acdc4151deca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:45.412602 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6f4776e-85ca-4acc-bfdc-acdc4151deca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:45.413374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6f4776e-85ca-4acc-bfdc-acdc4151deca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:45.413822 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6f4776e-85ca-4acc-bfdc-acdc4151deca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:45.443990 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f6f4776e-85ca-4acc-bfdc-acdc4151deca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Jul 21 17:46:45.444580 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 229/470] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:45 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:46.456616 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b44902e7-4833-47c2-84a8-665016defabe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:46.457609 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b44902e7-4833-47c2-84a8-665016defabe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:46.464801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b44902e7-4833-47c2-84a8-665016defabe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:46.465249 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b44902e7-4833-47c2-84a8-665016defabe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:46.466027 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b44902e7-4833-47c2-84a8-665016defabe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:46.466444 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b44902e7-4833-47c2-84a8-665016defabe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:46.495390 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b44902e7-4833-47c2-84a8-665016defabe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043278 Jul 21 17:46:46.495943 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 242/471] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:46 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:47.506900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-89c1dfe1-7efe-442d-9562-6ea522d8840f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:47.507957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-89c1dfe1-7efe-442d-9562-6ea522d8840f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:47.515028 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89c1dfe1-7efe-442d-9562-6ea522d8840f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:47.515485 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89c1dfe1-7efe-442d-9562-6ea522d8840f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:47.516259 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89c1dfe1-7efe-442d-9562-6ea522d8840f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:47.516729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89c1dfe1-7efe-442d-9562-6ea522d8840f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:47.547956 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-89c1dfe1-7efe-442d-9562-6ea522d8840f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045057 Jul 21 17:46:47.548568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 230/472] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:48.026279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:46:48.026519 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 17:46:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:46:48.559026 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-933f10d2-eb0e-461a-884d-0cb93b5a4ac4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:48.559965 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-933f10d2-eb0e-461a-884d-0cb93b5a4ac4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:48.566714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-933f10d2-eb0e-461a-884d-0cb93b5a4ac4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:48.567123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-933f10d2-eb0e-461a-884d-0cb93b5a4ac4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:48.567907 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-933f10d2-eb0e-461a-884d-0cb93b5a4ac4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:48.568544 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-933f10d2-eb0e-461a-884d-0cb93b5a4ac4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:48.598501 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-933f10d2-eb0e-461a-884d-0cb93b5a4ac4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043504 Jul 21 17:46:48.599055 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 243/473] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:48 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:49.609690 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ece478d6-c087-47f2-a500-2f899f3c9755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:49.610610 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ece478d6-c087-47f2-a500-2f899f3c9755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:49.617387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ece478d6-c087-47f2-a500-2f899f3c9755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:49.617832 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ece478d6-c087-47f2-a500-2f899f3c9755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:49.618618 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ece478d6-c087-47f2-a500-2f899f3c9755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:49.619086 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ece478d6-c087-47f2-a500-2f899f3c9755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:49.657669 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ece478d6-c087-47f2-a500-2f899f3c9755 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051799 Jul 21 17:46:49.658387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 231/474] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:49 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:50.669521 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-807d2e45-472d-4c8e-8952-053c98266465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:50.670341 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-807d2e45-472d-4c8e-8952-053c98266465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:50.677159 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-807d2e45-472d-4c8e-8952-053c98266465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:50.677605 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-807d2e45-472d-4c8e-8952-053c98266465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:50.679187 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-807d2e45-472d-4c8e-8952-053c98266465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:50.679187 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-807d2e45-472d-4c8e-8952-053c98266465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:50.709525 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-807d2e45-472d-4c8e-8952-053c98266465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044488 Jul 21 17:46:50.710081 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 244/475] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:50 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:51.721282 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-54efa04e-9822-40c6-a7dd-8f8d19a9087b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:51.722252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-54efa04e-9822-40c6-a7dd-8f8d19a9087b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:51.729187 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54efa04e-9822-40c6-a7dd-8f8d19a9087b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:51.729656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54efa04e-9822-40c6-a7dd-8f8d19a9087b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:51.730485 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54efa04e-9822-40c6-a7dd-8f8d19a9087b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:51.730926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54efa04e-9822-40c6-a7dd-8f8d19a9087b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:51.760566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-54efa04e-9822-40c6-a7dd-8f8d19a9087b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043082 Jul 21 17:46:51.761123 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 232/476] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:52.771833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0c6d642f-6788-4bb6-92b7-4c797022676b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:52.772802 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0c6d642f-6788-4bb6-92b7-4c797022676b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:52.779595 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0c6d642f-6788-4bb6-92b7-4c797022676b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:52.780053 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0c6d642f-6788-4bb6-92b7-4c797022676b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:52.780892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0c6d642f-6788-4bb6-92b7-4c797022676b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:52.781338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0c6d642f-6788-4bb6-92b7-4c797022676b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:52.812196 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0c6d642f-6788-4bb6-92b7-4c797022676b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Jul 21 17:46:52.812791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 245/477] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:52 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:53.822910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c8a91b30-2906-4b1a-8578-46209bd837a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:53.823836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c8a91b30-2906-4b1a-8578-46209bd837a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:53.830258 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c8a91b30-2906-4b1a-8578-46209bd837a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:53.830709 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c8a91b30-2906-4b1a-8578-46209bd837a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:53.831471 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c8a91b30-2906-4b1a-8578-46209bd837a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:53.832049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c8a91b30-2906-4b1a-8578-46209bd837a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:53.869234 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c8a91b30-2906-4b1a-8578-46209bd837a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050018 Jul 21 17:46:53.869616 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 233/478] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:53 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:54.880378 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ae53bbad-f8a3-419d-b1af-c7301e437750 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:54.881338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ae53bbad-f8a3-419d-b1af-c7301e437750 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:54.888311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae53bbad-f8a3-419d-b1af-c7301e437750 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:54.888770 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae53bbad-f8a3-419d-b1af-c7301e437750 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:54.889585 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae53bbad-f8a3-419d-b1af-c7301e437750 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:54.890030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae53bbad-f8a3-419d-b1af-c7301e437750 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:54.920248 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ae53bbad-f8a3-419d-b1af-c7301e437750 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043683 Jul 21 17:46:54.924148 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 246/479] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:54 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:55.930796 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-082cd13e-a6d6-4457-a28d-fddbdbdc31f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:55.932229 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-082cd13e-a6d6-4457-a28d-fddbdbdc31f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:55.939923 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-082cd13e-a6d6-4457-a28d-fddbdbdc31f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:55.940442 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-082cd13e-a6d6-4457-a28d-fddbdbdc31f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:55.941211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-082cd13e-a6d6-4457-a28d-fddbdbdc31f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:55.941699 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-082cd13e-a6d6-4457-a28d-fddbdbdc31f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:55.980883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-082cd13e-a6d6-4457-a28d-fddbdbdc31f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053804 Jul 21 17:46:55.981449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 234/480] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:55 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:56.992122 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bc97aa07-2bc6-4279-81bf-018b22aeef82 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:56.993105 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bc97aa07-2bc6-4279-81bf-018b22aeef82 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:57.000173 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc97aa07-2bc6-4279-81bf-018b22aeef82 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:57.000961 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc97aa07-2bc6-4279-81bf-018b22aeef82 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:57.001432 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc97aa07-2bc6-4279-81bf-018b22aeef82 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:57.001871 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc97aa07-2bc6-4279-81bf-018b22aeef82 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:57.033763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bc97aa07-2bc6-4279-81bf-018b22aeef82 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045440 Jul 21 17:46:57.034337 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 247/481] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:56 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:58.046263 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-50cb598f-cea8-44eb-8e3f-5e13098a2740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:58.047343 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-50cb598f-cea8-44eb-8e3f-5e13098a2740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:58.054011 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50cb598f-cea8-44eb-8e3f-5e13098a2740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:58.054610 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50cb598f-cea8-44eb-8e3f-5e13098a2740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:58.055409 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50cb598f-cea8-44eb-8e3f-5e13098a2740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:58.055847 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50cb598f-cea8-44eb-8e3f-5e13098a2740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:58.086513 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-50cb598f-cea8-44eb-8e3f-5e13098a2740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Jul 21 17:46:58.087063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 235/482] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:58 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:46:59.097732 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fb6d2502-5729-4f8c-86ea-013696c0dcb9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:46:59.098741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fb6d2502-5729-4f8c-86ea-013696c0dcb9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:46:59.105687 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb6d2502-5729-4f8c-86ea-013696c0dcb9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:59.106147 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb6d2502-5729-4f8c-86ea-013696c0dcb9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:59.106918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb6d2502-5729-4f8c-86ea-013696c0dcb9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:46:59.107358 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb6d2502-5729-4f8c-86ea-013696c0dcb9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:46:59.137821 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fb6d2502-5729-4f8c-86ea-013696c0dcb9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043882 Jul 21 17:46:59.138374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 248/483] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:46:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:00.149264 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-98302e98-07f8-44eb-98a5-29bda94f50fe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:00.151304 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-98302e98-07f8-44eb-98a5-29bda94f50fe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:00.154294 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=30 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:47:00.159802 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-98302e98-07f8-44eb-98a5-29bda94f50fe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:00.160254 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-98302e98-07f8-44eb-98a5-29bda94f50fe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:00.161054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-98302e98-07f8-44eb-98a5-29bda94f50fe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:00.161491 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-98302e98-07f8-44eb-98a5-29bda94f50fe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:00.165279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=90 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:47:00.191426 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-98302e98-07f8-44eb-98a5-29bda94f50fe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046891 Jul 21 17:47:00.191982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 236/484] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:01.202215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-56f0edc1-7ea9-4175-b5f5-1f3d5b966892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:01.203152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-56f0edc1-7ea9-4175-b5f5-1f3d5b966892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:01.213592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=30 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:47:01.213592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56f0edc1-7ea9-4175-b5f5-1f3d5b966892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:01.213592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56f0edc1-7ea9-4175-b5f5-1f3d5b966892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:01.213592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56f0edc1-7ea9-4175-b5f5-1f3d5b966892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:01.213943 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56f0edc1-7ea9-4175-b5f5-1f3d5b966892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:01.217365 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=90 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:47:01.245039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-56f0edc1-7ea9-4175-b5f5-1f3d5b966892 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047065 Jul 21 17:47:01.245837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 249/485] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:01 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:02.256812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-911d7a5f-aa19-4a2f-b22c-cbd9a721ff3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:02.257740 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-911d7a5f-aa19-4a2f-b22c-cbd9a721ff3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:02.265780 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-911d7a5f-aa19-4a2f-b22c-cbd9a721ff3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:02.266232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-911d7a5f-aa19-4a2f-b22c-cbd9a721ff3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:02.266996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-911d7a5f-aa19-4a2f-b22c-cbd9a721ff3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:02.267431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-911d7a5f-aa19-4a2f-b22c-cbd9a721ff3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:02.296611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-911d7a5f-aa19-4a2f-b22c-cbd9a721ff3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Jul 21 17:47:02.297237 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 237/486] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:03.307034 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d05f1a12-a012-4470-9f65-008cf7933468 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:03.308034 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d05f1a12-a012-4470-9f65-008cf7933468 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:03.314841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d05f1a12-a012-4470-9f65-008cf7933468 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:03.315297 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d05f1a12-a012-4470-9f65-008cf7933468 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:03.316080 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d05f1a12-a012-4470-9f65-008cf7933468 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:03.316622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d05f1a12-a012-4470-9f65-008cf7933468 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:03.346162 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d05f1a12-a012-4470-9f65-008cf7933468 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043116 Jul 21 17:47:03.347443 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 250/487] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:03 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:04.357602 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0f7d83fe-4738-4f71-86ab-02a174800bbe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:04.358716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0f7d83fe-4738-4f71-86ab-02a174800bbe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:04.365464 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f7d83fe-4738-4f71-86ab-02a174800bbe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:04.365981 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f7d83fe-4738-4f71-86ab-02a174800bbe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:04.366772 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f7d83fe-4738-4f71-86ab-02a174800bbe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:04.367217 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0f7d83fe-4738-4f71-86ab-02a174800bbe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:04.399062 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0f7d83fe-4738-4f71-86ab-02a174800bbe tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046369 Jul 21 17:47:04.403923 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 238/488] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:04 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:05.411109 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dc16b989-56de-41e3-bf73-7c0150296a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:05.412182 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dc16b989-56de-41e3-bf73-7c0150296a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:05.419517 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc16b989-56de-41e3-bf73-7c0150296a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:05.419971 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc16b989-56de-41e3-bf73-7c0150296a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:05.420765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc16b989-56de-41e3-bf73-7c0150296a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:05.421200 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc16b989-56de-41e3-bf73-7c0150296a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:05.451806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dc16b989-56de-41e3-bf73-7c0150296a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Jul 21 17:47:05.455555 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 251/489] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:06.463101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f9e0127b-93e8-42e6-895f-de37f033f8ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:06.464193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f9e0127b-93e8-42e6-895f-de37f033f8ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:06.470898 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9e0127b-93e8-42e6-895f-de37f033f8ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:06.471345 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9e0127b-93e8-42e6-895f-de37f033f8ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:06.472172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9e0127b-93e8-42e6-895f-de37f033f8ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:06.472647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9e0127b-93e8-42e6-895f-de37f033f8ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:06.503034 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f9e0127b-93e8-42e6-895f-de37f033f8ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043761 Jul 21 17:47:06.503588 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 239/490] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:06 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:07.041966 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:47:07.042198 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 17:47:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:47:07.515475 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-235bb36a-2875-4e50-a2c1-c263ac3a4334 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:07.516476 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-235bb36a-2875-4e50-a2c1-c263ac3a4334 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:07.523150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-235bb36a-2875-4e50-a2c1-c263ac3a4334 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:07.523602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-235bb36a-2875-4e50-a2c1-c263ac3a4334 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:07.533298 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-235bb36a-2875-4e50-a2c1-c263ac3a4334 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:07.533793 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-235bb36a-2875-4e50-a2c1-c263ac3a4334 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:07.576526 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-235bb36a-2875-4e50-a2c1-c263ac3a4334 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065168 Jul 21 17:47:07.577258 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 252/491] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:07 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:08.586749 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6e3e428c-de1c-489f-9ecc-fd2f8a3643b5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:08.588537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6e3e428c-de1c-489f-9ecc-fd2f8a3643b5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:08.595298 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e3e428c-de1c-489f-9ecc-fd2f8a3643b5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:08.595837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e3e428c-de1c-489f-9ecc-fd2f8a3643b5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:08.596783 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e3e428c-de1c-489f-9ecc-fd2f8a3643b5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:08.597219 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e3e428c-de1c-489f-9ecc-fd2f8a3643b5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:08.627413 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6e3e428c-de1c-489f-9ecc-fd2f8a3643b5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044482 Jul 21 17:47:08.627958 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 240/492] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:09.638706 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e1bcb380-9b5b-48ae-8970-8e894f12b666 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:09.639638 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e1bcb380-9b5b-48ae-8970-8e894f12b666 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:09.646148 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1bcb380-9b5b-48ae-8970-8e894f12b666 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:09.646601 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1bcb380-9b5b-48ae-8970-8e894f12b666 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:09.647368 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1bcb380-9b5b-48ae-8970-8e894f12b666 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:09.647817 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1bcb380-9b5b-48ae-8970-8e894f12b666 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:09.677434 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e1bcb380-9b5b-48ae-8970-8e894f12b666 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042694 Jul 21 17:47:09.678158 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 253/493] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:10.688938 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-73a83644-a52c-472e-94e3-34e267dc91d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:10.690186 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-73a83644-a52c-472e-94e3-34e267dc91d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:10.697391 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-73a83644-a52c-472e-94e3-34e267dc91d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:10.698086 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-73a83644-a52c-472e-94e3-34e267dc91d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:10.698951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-73a83644-a52c-472e-94e3-34e267dc91d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:10.699385 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-73a83644-a52c-472e-94e3-34e267dc91d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:10.729573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-73a83644-a52c-472e-94e3-34e267dc91d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044257 Jul 21 17:47:10.730958 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 241/494] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:10 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:11.741196 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d3aabb19-7818-4bd9-adc1-8469b48b9840 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:11.742128 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d3aabb19-7818-4bd9-adc1-8469b48b9840 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:11.748850 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d3aabb19-7818-4bd9-adc1-8469b48b9840 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:11.749302 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d3aabb19-7818-4bd9-adc1-8469b48b9840 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:11.750079 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d3aabb19-7818-4bd9-adc1-8469b48b9840 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:11.750514 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d3aabb19-7818-4bd9-adc1-8469b48b9840 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:11.784074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d3aabb19-7818-4bd9-adc1-8469b48b9840 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046641 Jul 21 17:47:11.785503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 254/495] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:11 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:12.796642 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e331d716-9676-4438-b729-9393511d5e85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:12.797584 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e331d716-9676-4438-b729-9393511d5e85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:12.804059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e331d716-9676-4438-b729-9393511d5e85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:12.804585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e331d716-9676-4438-b729-9393511d5e85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:12.805444 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e331d716-9676-4438-b729-9393511d5e85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:12.805920 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e331d716-9676-4438-b729-9393511d5e85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:12.836079 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e331d716-9676-4438-b729-9393511d5e85 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043359 Jul 21 17:47:12.836678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 242/496] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:12 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:13.847263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a33ccebe-acb4-48c7-98a9-f56d123b3fe6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:13.848190 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a33ccebe-acb4-48c7-98a9-f56d123b3fe6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:13.854865 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a33ccebe-acb4-48c7-98a9-f56d123b3fe6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:13.855307 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a33ccebe-acb4-48c7-98a9-f56d123b3fe6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:13.856067 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a33ccebe-acb4-48c7-98a9-f56d123b3fe6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:13.856535 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a33ccebe-acb4-48c7-98a9-f56d123b3fe6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:13.887117 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a33ccebe-acb4-48c7-98a9-f56d123b3fe6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043866 Jul 21 17:47:13.887681 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 255/497] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:14.898498 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-71bfe452-20a9-4121-80e3-d8f528436542 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:14.899372 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-71bfe452-20a9-4121-80e3-d8f528436542 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:14.906539 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-71bfe452-20a9-4121-80e3-d8f528436542 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:14.907003 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-71bfe452-20a9-4121-80e3-d8f528436542 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:14.907775 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-71bfe452-20a9-4121-80e3-d8f528436542 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:14.908220 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-71bfe452-20a9-4121-80e3-d8f528436542 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:14.937638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-71bfe452-20a9-4121-80e3-d8f528436542 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043066 Jul 21 17:47:14.938218 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 243/498] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:14 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:15.949513 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c416adb3-965a-44d9-a91c-0d492a96c771 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:15.950442 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c416adb3-965a-44d9-a91c-0d492a96c771 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:15.957076 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c416adb3-965a-44d9-a91c-0d492a96c771 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:15.957531 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c416adb3-965a-44d9-a91c-0d492a96c771 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:15.958306 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c416adb3-965a-44d9-a91c-0d492a96c771 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:15.958782 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c416adb3-965a-44d9-a91c-0d492a96c771 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:15.989491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c416adb3-965a-44d9-a91c-0d492a96c771 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Jul 21 17:47:15.990299 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 256/499] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:17.001143 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-218a5004-649a-4b67-86c5-ba9971229cf6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:17.002063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-218a5004-649a-4b67-86c5-ba9971229cf6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:17.008386 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-218a5004-649a-4b67-86c5-ba9971229cf6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:17.008836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-218a5004-649a-4b67-86c5-ba9971229cf6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:17.010293 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-218a5004-649a-4b67-86c5-ba9971229cf6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:17.010870 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-218a5004-649a-4b67-86c5-ba9971229cf6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:17.039740 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-218a5004-649a-4b67-86c5-ba9971229cf6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042286 Jul 21 17:47:17.040137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 244/500] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:16 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:18.051015 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7fcfe4ec-2822-4167-bcf7-7fdf1b91f0f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:18.051947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7fcfe4ec-2822-4167-bcf7-7fdf1b91f0f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:18.058528 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fcfe4ec-2822-4167-bcf7-7fdf1b91f0f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:18.059061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fcfe4ec-2822-4167-bcf7-7fdf1b91f0f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:18.059916 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fcfe4ec-2822-4167-bcf7-7fdf1b91f0f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:18.060483 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fcfe4ec-2822-4167-bcf7-7fdf1b91f0f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:18.091636 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7fcfe4ec-2822-4167-bcf7-7fdf1b91f0f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Jul 21 17:47:18.092251 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 257/501] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:18 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:19.102912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1af10841-d3d1-403e-a231-4d25f095b809 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:19.104603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1af10841-d3d1-403e-a231-4d25f095b809 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:19.111075 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1af10841-d3d1-403e-a231-4d25f095b809 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:19.111639 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1af10841-d3d1-403e-a231-4d25f095b809 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:19.112465 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1af10841-d3d1-403e-a231-4d25f095b809 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:19.112972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1af10841-d3d1-403e-a231-4d25f095b809 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:19.142294 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1af10841-d3d1-403e-a231-4d25f095b809 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043287 Jul 21 17:47:19.142853 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 245/502] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:19 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:20.153903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-974675ed-50a1-4354-a164-73dfd55b1272 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:20.154831 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-974675ed-50a1-4354-a164-73dfd55b1272 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:20.162185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-974675ed-50a1-4354-a164-73dfd55b1272 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:20.162641 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-974675ed-50a1-4354-a164-73dfd55b1272 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:20.163419 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-974675ed-50a1-4354-a164-73dfd55b1272 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:20.163859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-974675ed-50a1-4354-a164-73dfd55b1272 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:20.195524 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-974675ed-50a1-4354-a164-73dfd55b1272 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Jul 21 17:47:20.197760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 258/503] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:20 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:21.206788 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-36d26cc7-37ff-4918-9220-cc262760fddb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:21.207707 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-36d26cc7-37ff-4918-9220-cc262760fddb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:21.215033 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36d26cc7-37ff-4918-9220-cc262760fddb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:21.215483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36d26cc7-37ff-4918-9220-cc262760fddb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:21.216260 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36d26cc7-37ff-4918-9220-cc262760fddb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:21.216720 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36d26cc7-37ff-4918-9220-cc262760fddb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:21.246355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-36d26cc7-37ff-4918-9220-cc262760fddb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043452 Jul 21 17:47:21.246906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 246/504] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:22.257638 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fe3eabae-4845-450a-b1fb-5a114f1d6c2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:22.258567 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fe3eabae-4845-450a-b1fb-5a114f1d6c2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:22.266362 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fe3eabae-4845-450a-b1fb-5a114f1d6c2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:22.266812 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fe3eabae-4845-450a-b1fb-5a114f1d6c2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:22.267627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fe3eabae-4845-450a-b1fb-5a114f1d6c2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:22.268063 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fe3eabae-4845-450a-b1fb-5a114f1d6c2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:22.300095 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fe3eabae-4845-450a-b1fb-5a114f1d6c2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046333 Jul 21 17:47:22.300692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 259/505] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:22 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:23.311419 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e9c475e5-4e00-44b1-a974-526a374739de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:23.312402 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e9c475e5-4e00-44b1-a974-526a374739de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:23.319063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9c475e5-4e00-44b1-a974-526a374739de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:23.319515 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9c475e5-4e00-44b1-a974-526a374739de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:23.320286 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9c475e5-4e00-44b1-a974-526a374739de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:23.320750 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9c475e5-4e00-44b1-a974-526a374739de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:23.351791 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e9c475e5-4e00-44b1-a974-526a374739de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Jul 21 17:47:23.352268 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 247/506] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:23 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:24.363004 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9fb35788-6037-40da-a5ad-5720cee4eda4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:24.363938 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9fb35788-6037-40da-a5ad-5720cee4eda4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:24.370965 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9fb35788-6037-40da-a5ad-5720cee4eda4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:24.371428 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9fb35788-6037-40da-a5ad-5720cee4eda4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:24.372224 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9fb35788-6037-40da-a5ad-5720cee4eda4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:24.372708 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9fb35788-6037-40da-a5ad-5720cee4eda4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:24.402781 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9fb35788-6037-40da-a5ad-5720cee4eda4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043768 Jul 21 17:47:24.403319 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 260/507] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:24 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:25.413864 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b690208b-d19a-473f-b81b-8248c3476587 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:25.414889 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b690208b-d19a-473f-b81b-8248c3476587 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:25.422469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b690208b-d19a-473f-b81b-8248c3476587 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:25.423002 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b690208b-d19a-473f-b81b-8248c3476587 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:25.423841 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b690208b-d19a-473f-b81b-8248c3476587 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:25.424460 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b690208b-d19a-473f-b81b-8248c3476587 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:25.455167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b690208b-d19a-473f-b81b-8248c3476587 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045072 Jul 21 17:47:25.455685 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 248/508] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:25 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:26.466801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bedfade0-6106-45e2-9776-ace774230b9c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:26.467724 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bedfade0-6106-45e2-9776-ace774230b9c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:26.474090 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bedfade0-6106-45e2-9776-ace774230b9c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:26.474538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bedfade0-6106-45e2-9776-ace774230b9c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:26.475309 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bedfade0-6106-45e2-9776-ace774230b9c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:26.475731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bedfade0-6106-45e2-9776-ace774230b9c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:26.505860 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bedfade0-6106-45e2-9776-ace774230b9c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043343 Jul 21 17:47:26.506419 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 261/509] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:26 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:47:27.517862 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d51235f2-3f32-4a03-956f-89040ec62c96 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:27.518790 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d51235f2-3f32-4a03-956f-89040ec62c96 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:27.525119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d51235f2-3f32-4a03-956f-89040ec62c96 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:27.525568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d51235f2-3f32-4a03-956f-89040ec62c96 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:27.526325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d51235f2-3f32-4a03-956f-89040ec62c96 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:27.526811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d51235f2-3f32-4a03-956f-89040ec62c96 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:27.556614 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d51235f2-3f32-4a03-956f-89040ec62c96 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042520 Jul 21 17:47:27.557167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 249/510] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:27 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:28.569222 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cadebabd-d60b-4ad6-afdf-9524800b01e0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:28.570187 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cadebabd-d60b-4ad6-afdf-9524800b01e0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:28.577267 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cadebabd-d60b-4ad6-afdf-9524800b01e0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:28.577725 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cadebabd-d60b-4ad6-afdf-9524800b01e0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:28.578500 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cadebabd-d60b-4ad6-afdf-9524800b01e0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:28.578948 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cadebabd-d60b-4ad6-afdf-9524800b01e0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:28.609126 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cadebabd-d60b-4ad6-afdf-9524800b01e0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044060 Jul 21 17:47:28.609702 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 262/511] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:28 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:29.621050 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bbd071fa-46e5-4ac3-85c1-bff5c1356416 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:29.622115 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bbd071fa-46e5-4ac3-85c1-bff5c1356416 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:29.628476 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bbd071fa-46e5-4ac3-85c1-bff5c1356416 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:29.628922 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bbd071fa-46e5-4ac3-85c1-bff5c1356416 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:29.629710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bbd071fa-46e5-4ac3-85c1-bff5c1356416 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:29.630142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bbd071fa-46e5-4ac3-85c1-bff5c1356416 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:29.662012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bbd071fa-46e5-4ac3-85c1-bff5c1356416 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045223 Jul 21 17:47:29.662617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 250/512] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:29 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:30.681408 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-970d26f3-3393-42db-aa03-608dd850ad10 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:30.682336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-970d26f3-3393-42db-aa03-608dd850ad10 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:30.689393 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-970d26f3-3393-42db-aa03-608dd850ad10 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:30.690227 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-970d26f3-3393-42db-aa03-608dd850ad10 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:30.690844 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-970d26f3-3393-42db-aa03-608dd850ad10 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:30.691279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-970d26f3-3393-42db-aa03-608dd850ad10 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:30.723843 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-970d26f3-3393-42db-aa03-608dd850ad10 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Jul 21 17:47:30.724419 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 263/513] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:30 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:31.735879 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3b39880d-9055-4cc1-af73-194cb34d382a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:31.736868 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3b39880d-9055-4cc1-af73-194cb34d382a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:31.738980 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=30 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:47:31.744994 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b39880d-9055-4cc1-af73-194cb34d382a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:31.745448 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b39880d-9055-4cc1-af73-194cb34d382a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:31.746782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b39880d-9055-4cc1-af73-194cb34d382a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:31.747403 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b39880d-9055-4cc1-af73-194cb34d382a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:31.751282 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=90 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:47:31.778032 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3b39880d-9055-4cc1-af73-194cb34d382a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045701 Jul 21 17:47:31.778729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 251/514] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:32.790005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-93bf5a56-d98e-450a-a6d2-124bf70a59f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:32.790924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-93bf5a56-d98e-450a-a6d2-124bf70a59f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:32.794105 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=30 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:47:32.799598 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93bf5a56-d98e-450a-a6d2-124bf70a59f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:32.800049 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93bf5a56-d98e-450a-a6d2-124bf70a59f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:32.800844 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93bf5a56-d98e-450a-a6d2-124bf70a59f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:32.801274 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93bf5a56-d98e-450a-a6d2-124bf70a59f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:32.804922 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=90 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:47:32.832166 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-93bf5a56-d98e-450a-a6d2-124bf70a59f1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046351 Jul 21 17:47:32.832747 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 264/515] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:32 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:33.843505 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8d8a9187-4c8e-400e-87c8-d354b4754a09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:33.844511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8d8a9187-4c8e-400e-87c8-d354b4754a09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:33.850991 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d8a9187-4c8e-400e-87c8-d354b4754a09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:33.851438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d8a9187-4c8e-400e-87c8-d354b4754a09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:33.852203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d8a9187-4c8e-400e-87c8-d354b4754a09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:33.852669 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d8a9187-4c8e-400e-87c8-d354b4754a09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:33.883118 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8d8a9187-4c8e-400e-87c8-d354b4754a09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043556 Jul 21 17:47:33.883670 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 252/516] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:33 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:34.895240 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2b83cec1-44aa-40e1-9300-bcb627668c95 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:34.896172 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2b83cec1-44aa-40e1-9300-bcb627668c95 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:34.902648 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2b83cec1-44aa-40e1-9300-bcb627668c95 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:34.903428 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2b83cec1-44aa-40e1-9300-bcb627668c95 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:34.903862 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2b83cec1-44aa-40e1-9300-bcb627668c95 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:34.904320 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2b83cec1-44aa-40e1-9300-bcb627668c95 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:34.942638 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2b83cec1-44aa-40e1-9300-bcb627668c95 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051716 Jul 21 17:47:34.943408 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 265/517] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:34 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:35.955327 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ff18b05d-d108-4124-80e4-628026a96e49 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:35.956347 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ff18b05d-d108-4124-80e4-628026a96e49 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:35.962422 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff18b05d-d108-4124-80e4-628026a96e49 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:35.962867 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff18b05d-d108-4124-80e4-628026a96e49 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:35.963625 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff18b05d-d108-4124-80e4-628026a96e49 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:35.964059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff18b05d-d108-4124-80e4-628026a96e49 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:35.994623 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ff18b05d-d108-4124-80e4-628026a96e49 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043658 Jul 21 17:47:35.995176 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 253/518] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:35 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:47:37.006099 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2325b943-d123-4196-8cab-0ea36cd67245 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:37.007024 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2325b943-d123-4196-8cab-0ea36cd67245 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:37.014092 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2325b943-d123-4196-8cab-0ea36cd67245 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:37.014550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2325b943-d123-4196-8cab-0ea36cd67245 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:37.015325 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2325b943-d123-4196-8cab-0ea36cd67245 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:37.015765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2325b943-d123-4196-8cab-0ea36cd67245 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:37.047195 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2325b943-d123-4196-8cab-0ea36cd67245 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044934 Jul 21 17:47:37.047760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 266/519] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:37 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:38.058440 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a92ee31f-c576-43b4-a455-9b5ae0451d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:38.060091 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a92ee31f-c576-43b4-a455-9b5ae0451d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:38.066557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a92ee31f-c576-43b4-a455-9b5ae0451d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:38.067004 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a92ee31f-c576-43b4-a455-9b5ae0451d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:38.067768 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a92ee31f-c576-43b4-a455-9b5ae0451d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:38.068199 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a92ee31f-c576-43b4-a455-9b5ae0451d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:38.097880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a92ee31f-c576-43b4-a455-9b5ae0451d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043203 Jul 21 17:47:38.098574 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 254/520] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:38 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:39.109447 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8875675f-5a45-4e34-b1cb-0a8a7ea3fe7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:39.110438 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8875675f-5a45-4e34-b1cb-0a8a7ea3fe7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:39.117120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8875675f-5a45-4e34-b1cb-0a8a7ea3fe7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:39.117571 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8875675f-5a45-4e34-b1cb-0a8a7ea3fe7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:39.118338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8875675f-5a45-4e34-b1cb-0a8a7ea3fe7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:39.118779 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8875675f-5a45-4e34-b1cb-0a8a7ea3fe7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:39.148237 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8875675f-5a45-4e34-b1cb-0a8a7ea3fe7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043246 Jul 21 17:47:39.149111 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 267/521] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:39 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:40.159066 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ef286260-d41a-4325-af71-6473c362ca48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:40.159990 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ef286260-d41a-4325-af71-6473c362ca48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:40.166590 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef286260-d41a-4325-af71-6473c362ca48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:40.167048 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef286260-d41a-4325-af71-6473c362ca48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:40.167824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef286260-d41a-4325-af71-6473c362ca48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:40.168698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef286260-d41a-4325-af71-6473c362ca48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:40.206965 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ef286260-d41a-4325-af71-6473c362ca48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043334 Jul 21 17:47:40.206965 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 255/522] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:41.211185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8ec516d5-5c53-4f0e-a9b3-222e44d26986 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:41.212115 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8ec516d5-5c53-4f0e-a9b3-222e44d26986 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:41.225472 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8ec516d5-5c53-4f0e-a9b3-222e44d26986 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:41.225472 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8ec516d5-5c53-4f0e-a9b3-222e44d26986 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:41.225472 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8ec516d5-5c53-4f0e-a9b3-222e44d26986 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:41.225472 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8ec516d5-5c53-4f0e-a9b3-222e44d26986 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:41.252226 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8ec516d5-5c53-4f0e-a9b3-222e44d26986 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Jul 21 17:47:41.252926 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 268/523] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:41 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:42.265076 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-79dd7ce2-2254-44c7-b334-a3d18f10f704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:42.266005 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-79dd7ce2-2254-44c7-b334-a3d18f10f704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:42.280328 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79dd7ce2-2254-44c7-b334-a3d18f10f704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:42.280328 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79dd7ce2-2254-44c7-b334-a3d18f10f704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:42.280328 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79dd7ce2-2254-44c7-b334-a3d18f10f704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:42.280328 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79dd7ce2-2254-44c7-b334-a3d18f10f704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:42.304175 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-79dd7ce2-2254-44c7-b334-a3d18f10f704 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044246 Jul 21 17:47:42.304770 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 256/524] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:42 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:43.315806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2de3ff35-cd3b-416d-bf6c-573721ec65ca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:43.316827 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2de3ff35-cd3b-416d-bf6c-573721ec65ca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:43.323403 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2de3ff35-cd3b-416d-bf6c-573721ec65ca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:43.323854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2de3ff35-cd3b-416d-bf6c-573721ec65ca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:43.325615 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2de3ff35-cd3b-416d-bf6c-573721ec65ca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:43.326105 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2de3ff35-cd3b-416d-bf6c-573721ec65ca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:43.356069 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2de3ff35-cd3b-416d-bf6c-573721ec65ca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 Jul 21 17:47:43.356513 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 269/525] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:44.367026 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b013d36a-886e-40f9-b185-735094082134 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:44.367931 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b013d36a-886e-40f9-b185-735094082134 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:44.374909 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b013d36a-886e-40f9-b185-735094082134 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:44.375362 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b013d36a-886e-40f9-b185-735094082134 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:44.376129 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b013d36a-886e-40f9-b185-735094082134 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:44.376588 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b013d36a-886e-40f9-b185-735094082134 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:44.406237 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b013d36a-886e-40f9-b185-735094082134 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043085 Jul 21 17:47:44.406800 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 257/526] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:44 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:45.417848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1c92120d-a854-426c-bc86-3edda32c7117 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:45.419394 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1c92120d-a854-426c-bc86-3edda32c7117 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:45.425890 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1c92120d-a854-426c-bc86-3edda32c7117 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:45.427850 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1c92120d-a854-426c-bc86-3edda32c7117 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:45.427850 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1c92120d-a854-426c-bc86-3edda32c7117 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:45.427850 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1c92120d-a854-426c-bc86-3edda32c7117 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:45.459314 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1c92120d-a854-426c-bc86-3edda32c7117 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Jul 21 17:47:45.459870 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 270/527] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:45 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:46.470930 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-94178933-27b6-4861-9508-8e58d78b1f5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:46.471869 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-94178933-27b6-4861-9508-8e58d78b1f5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:46.478226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94178933-27b6-4861-9508-8e58d78b1f5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:46.478679 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94178933-27b6-4861-9508-8e58d78b1f5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:46.479461 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94178933-27b6-4861-9508-8e58d78b1f5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:46.479902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94178933-27b6-4861-9508-8e58d78b1f5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:46.509638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-94178933-27b6-4861-9508-8e58d78b1f5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042655 Jul 21 17:47:46.510195 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 258/528] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:46 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:47.521473 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e5ecf157-3e54-4cde-b28c-f809772b88cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:47.522400 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e5ecf157-3e54-4cde-b28c-f809772b88cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:47.529285 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e5ecf157-3e54-4cde-b28c-f809772b88cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:47.529741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e5ecf157-3e54-4cde-b28c-f809772b88cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:47.530498 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e5ecf157-3e54-4cde-b28c-f809772b88cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:47.530928 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e5ecf157-3e54-4cde-b28c-f809772b88cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:47.561647 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e5ecf157-3e54-4cde-b28c-f809772b88cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Jul 21 17:47:47.565798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 271/529] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:48.573182 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ed278f7a-2724-48cb-959c-ca272695cc7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:48.574138 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ed278f7a-2724-48cb-959c-ca272695cc7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:48.580933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed278f7a-2724-48cb-959c-ca272695cc7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:48.581391 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed278f7a-2724-48cb-959c-ca272695cc7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:48.582168 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed278f7a-2724-48cb-959c-ca272695cc7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:48.582606 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed278f7a-2724-48cb-959c-ca272695cc7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:48.612797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ed278f7a-2724-48cb-959c-ca272695cc7e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043406 Jul 21 17:47:48.613361 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 259/530] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:48 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:49.623478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7560dca5-2022-4465-b41d-dddacda3d1d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:49.624433 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7560dca5-2022-4465-b41d-dddacda3d1d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:49.630915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7560dca5-2022-4465-b41d-dddacda3d1d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:49.631365 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7560dca5-2022-4465-b41d-dddacda3d1d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:49.632129 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7560dca5-2022-4465-b41d-dddacda3d1d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:49.632607 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7560dca5-2022-4465-b41d-dddacda3d1d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:49.662509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7560dca5-2022-4465-b41d-dddacda3d1d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042952 Jul 21 17:47:49.663069 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 272/531] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:49 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:50.675037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c8459949-1cfd-42c8-83fd-1a16f8d09fd5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:50.675966 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c8459949-1cfd-42c8-83fd-1a16f8d09fd5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:50.682120 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c8459949-1cfd-42c8-83fd-1a16f8d09fd5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:50.682575 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c8459949-1cfd-42c8-83fd-1a16f8d09fd5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:50.683356 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c8459949-1cfd-42c8-83fd-1a16f8d09fd5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:50.684433 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c8459949-1cfd-42c8-83fd-1a16f8d09fd5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:50.714314 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c8459949-1cfd-42c8-83fd-1a16f8d09fd5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043451 Jul 21 17:47:50.715848 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 260/532] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:50 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:51.726630 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2cb24454-9848-4f2e-a502-94cc4a43127b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:51.727565 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2cb24454-9848-4f2e-a502-94cc4a43127b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:51.734960 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2cb24454-9848-4f2e-a502-94cc4a43127b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:51.735413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2cb24454-9848-4f2e-a502-94cc4a43127b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:51.736182 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2cb24454-9848-4f2e-a502-94cc4a43127b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:51.736654 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2cb24454-9848-4f2e-a502-94cc4a43127b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:51.766808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2cb24454-9848-4f2e-a502-94cc4a43127b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Jul 21 17:47:51.768694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 273/533] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:52.778268 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6ca0cfc3-bd91-40b5-aa6c-8d44dad42a43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:52.779199 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6ca0cfc3-bd91-40b5-aa6c-8d44dad42a43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:52.785617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6ca0cfc3-bd91-40b5-aa6c-8d44dad42a43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:52.786059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6ca0cfc3-bd91-40b5-aa6c-8d44dad42a43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:52.786824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6ca0cfc3-bd91-40b5-aa6c-8d44dad42a43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:52.787255 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6ca0cfc3-bd91-40b5-aa6c-8d44dad42a43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:52.817379 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6ca0cfc3-bd91-40b5-aa6c-8d44dad42a43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043272 Jul 21 17:47:52.817940 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 261/534] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:52 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:53.829523 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9785359b-7157-40f2-8eb1-2af927d72d20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:53.830454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9785359b-7157-40f2-8eb1-2af927d72d20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:53.837094 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9785359b-7157-40f2-8eb1-2af927d72d20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:53.837549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9785359b-7157-40f2-8eb1-2af927d72d20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:53.838330 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9785359b-7157-40f2-8eb1-2af927d72d20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:53.838773 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9785359b-7157-40f2-8eb1-2af927d72d20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:53.870559 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9785359b-7157-40f2-8eb1-2af927d72d20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Jul 21 17:47:53.871305 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 274/535] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:53 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:54.883257 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7756a628-7f18-44b1-9458-9d28ac97a8fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:54.884184 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7756a628-7f18-44b1-9458-9d28ac97a8fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:54.891180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7756a628-7f18-44b1-9458-9d28ac97a8fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:54.891632 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7756a628-7f18-44b1-9458-9d28ac97a8fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:54.892429 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7756a628-7f18-44b1-9458-9d28ac97a8fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:54.892873 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7756a628-7f18-44b1-9458-9d28ac97a8fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:54.923146 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7756a628-7f18-44b1-9458-9d28ac97a8fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044423 Jul 21 17:47:54.923710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 262/536] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:54 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:55.934980 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3d4b1655-ff3f-4eeb-94c6-c9a129739d47 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:55.935904 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3d4b1655-ff3f-4eeb-94c6-c9a129739d47 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:55.942832 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3d4b1655-ff3f-4eeb-94c6-c9a129739d47 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:55.943277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3d4b1655-ff3f-4eeb-94c6-c9a129739d47 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:55.944043 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3d4b1655-ff3f-4eeb-94c6-c9a129739d47 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:55.944504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3d4b1655-ff3f-4eeb-94c6-c9a129739d47 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:55.973981 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3d4b1655-ff3f-4eeb-94c6-c9a129739d47 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042994 Jul 21 17:47:55.974547 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 275/537] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:55 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:56.985900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5c706ba6-8df6-4c26-9fbe-8444965291bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:56.986827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5c706ba6-8df6-4c26-9fbe-8444965291bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:56.993440 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c706ba6-8df6-4c26-9fbe-8444965291bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:56.993891 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c706ba6-8df6-4c26-9fbe-8444965291bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:56.994661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c706ba6-8df6-4c26-9fbe-8444965291bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:56.995101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c706ba6-8df6-4c26-9fbe-8444965291bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:57.026223 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5c706ba6-8df6-4c26-9fbe-8444965291bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044235 Jul 21 17:47:57.026789 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 263/538] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:56 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:47:58.038555 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-403ead91-f68d-437c-a124-3bbf11164512 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:58.039487 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-403ead91-f68d-437c-a124-3bbf11164512 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:58.046723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-403ead91-f68d-437c-a124-3bbf11164512 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:58.047182 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-403ead91-f68d-437c-a124-3bbf11164512 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:58.048058 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-403ead91-f68d-437c-a124-3bbf11164512 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:58.048424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-403ead91-f68d-437c-a124-3bbf11164512 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:58.078696 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-403ead91-f68d-437c-a124-3bbf11164512 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043837 Jul 21 17:47:58.079753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 276/539] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:58 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:47:59.091857 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fa7a8347-708b-4d4e-9c97-800bcf877a44 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:47:59.092844 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fa7a8347-708b-4d4e-9c97-800bcf877a44 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:47:59.099300 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa7a8347-708b-4d4e-9c97-800bcf877a44 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:59.099756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa7a8347-708b-4d4e-9c97-800bcf877a44 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:59.100634 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa7a8347-708b-4d4e-9c97-800bcf877a44 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:47:59.101071 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa7a8347-708b-4d4e-9c97-800bcf877a44 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:47:59.130929 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fa7a8347-708b-4d4e-9c97-800bcf877a44 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042954 Jul 21 17:47:59.131485 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 264/540] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:47:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:00.143175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bd3f578d-9158-42ba-ad44-293311d5d4a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:00.144111 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bd3f578d-9158-42ba-ad44-293311d5d4a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:00.150699 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bd3f578d-9158-42ba-ad44-293311d5d4a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:00.151148 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bd3f578d-9158-42ba-ad44-293311d5d4a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:00.151913 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bd3f578d-9158-42ba-ad44-293311d5d4a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:00.152395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bd3f578d-9158-42ba-ad44-293311d5d4a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:00.182318 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bd3f578d-9158-42ba-ad44-293311d5d4a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043181 Jul 21 17:48:00.182879 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 277/541] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:01.195345 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e712635b-8efe-42a1-89ca-a56370b87221 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:01.196279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e712635b-8efe-42a1-89ca-a56370b87221 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:01.202930 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e712635b-8efe-42a1-89ca-a56370b87221 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:01.203389 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e712635b-8efe-42a1-89ca-a56370b87221 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:01.204161 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e712635b-8efe-42a1-89ca-a56370b87221 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:01.204739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e712635b-8efe-42a1-89ca-a56370b87221 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:01.235631 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e712635b-8efe-42a1-89ca-a56370b87221 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044390 Jul 21 17:48:01.236194 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 265/542] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:01 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:02.248253 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c868152e-2ed5-4dcd-93a2-750c6d5f581c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:02.249136 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c868152e-2ed5-4dcd-93a2-750c6d5f581c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:02.255094 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c868152e-2ed5-4dcd-93a2-750c6d5f581c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:02.255560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c868152e-2ed5-4dcd-93a2-750c6d5f581c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:02.256338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c868152e-2ed5-4dcd-93a2-750c6d5f581c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:02.256776 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c868152e-2ed5-4dcd-93a2-750c6d5f581c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:02.285593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c868152e-2ed5-4dcd-93a2-750c6d5f581c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042138 Jul 21 17:48:02.286323 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 278/543] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:03.296559 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a2513c87-90f5-408c-920c-ebf90b63eddf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:03.297412 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a2513c87-90f5-408c-920c-ebf90b63eddf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:03.299801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=30 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:48:03.305347 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2513c87-90f5-408c-920c-ebf90b63eddf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:03.305804 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2513c87-90f5-408c-920c-ebf90b63eddf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:03.306564 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2513c87-90f5-408c-920c-ebf90b63eddf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:03.307005 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2513c87-90f5-408c-920c-ebf90b63eddf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:03.310239 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=90 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:48:03.345515 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a2513c87-90f5-408c-920c-ebf90b63eddf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052808 Jul 21 17:48:03.346423 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 266/544] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:03 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:04.357572 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-80e0ca8c-7236-4a8f-9971-f207ab1174a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:04.358497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-80e0ca8c-7236-4a8f-9971-f207ab1174a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:04.360901 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=30 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:48:04.366538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80e0ca8c-7236-4a8f-9971-f207ab1174a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:04.366983 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80e0ca8c-7236-4a8f-9971-f207ab1174a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:04.367751 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80e0ca8c-7236-4a8f-9971-f207ab1174a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:04.368182 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80e0ca8c-7236-4a8f-9971-f207ab1174a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:04.370618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=90 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:48:04.398739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-80e0ca8c-7236-4a8f-9971-f207ab1174a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045275 Jul 21 17:48:04.399296 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 279/545] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:04 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:05.410504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d346527b-ae16-44f0-95c3-c9599c71a48f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:05.411494 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d346527b-ae16-44f0-95c3-c9599c71a48f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:05.418094 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d346527b-ae16-44f0-95c3-c9599c71a48f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:05.418548 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d346527b-ae16-44f0-95c3-c9599c71a48f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:05.420541 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d346527b-ae16-44f0-95c3-c9599c71a48f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:05.420986 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d346527b-ae16-44f0-95c3-c9599c71a48f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:05.450896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d346527b-ae16-44f0-95c3-c9599c71a48f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043814 Jul 21 17:48:05.451729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 267/546] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:06.462671 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-76119025-9ef2-4b1d-a843-42acf8d1ab15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:06.463591 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-76119025-9ef2-4b1d-a843-42acf8d1ab15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:06.470851 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-76119025-9ef2-4b1d-a843-42acf8d1ab15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:06.471302 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-76119025-9ef2-4b1d-a843-42acf8d1ab15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:06.472068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-76119025-9ef2-4b1d-a843-42acf8d1ab15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:06.472544 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-76119025-9ef2-4b1d-a843-42acf8d1ab15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:06.502174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-76119025-9ef2-4b1d-a843-42acf8d1ab15 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043429 Jul 21 17:48:06.502735 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 280/547] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:06 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:07.514192 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9b49dd2f-f1f8-49b7-9797-fe2357a1bc3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:07.515142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9b49dd2f-f1f8-49b7-9797-fe2357a1bc3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:07.521972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b49dd2f-f1f8-49b7-9797-fe2357a1bc3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:07.522432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b49dd2f-f1f8-49b7-9797-fe2357a1bc3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:07.523214 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b49dd2f-f1f8-49b7-9797-fe2357a1bc3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:07.523659 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b49dd2f-f1f8-49b7-9797-fe2357a1bc3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:07.553312 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9b49dd2f-f1f8-49b7-9797-fe2357a1bc3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043446 Jul 21 17:48:07.554062 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 268/548] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:07 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:08.565718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ec0f4f7c-0623-4a77-81eb-596b968f3514 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:08.566640 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ec0f4f7c-0623-4a77-81eb-596b968f3514 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:08.573491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ec0f4f7c-0623-4a77-81eb-596b968f3514 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:08.573939 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ec0f4f7c-0623-4a77-81eb-596b968f3514 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:08.574701 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ec0f4f7c-0623-4a77-81eb-596b968f3514 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:08.575792 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ec0f4f7c-0623-4a77-81eb-596b968f3514 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:08.604367 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ec0f4f7c-0623-4a77-81eb-596b968f3514 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042926 Jul 21 17:48:08.605233 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 281/549] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:48:08.661678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-16b81599-5142-452d-9165-5c5ccba33563 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:08.662251 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-16b81599-5142-452d-9165-5c5ccba33563 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:08.669422 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16b81599-5142-452d-9165-5c5ccba33563 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:08.669881 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16b81599-5142-452d-9165-5c5ccba33563 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:08.670656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16b81599-5142-452d-9165-5c5ccba33563 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:08.671100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16b81599-5142-452d-9165-5c5ccba33563 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:08.696330 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-16b81599-5142-452d-9165-5c5ccba33563 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 17:48:08.775365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-16b81599-5142-452d-9165-5c5ccba33563 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 204 len: 0 microversion: 2.1 time: 0.117366 Jul 21 17:48:08.775947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 269/550] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 17:48:08 2022] DELETE /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 17:48:08.785323 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dff57176-d5e8-4219-bb7e-d6271e5b4d3b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:08.786113 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dff57176-d5e8-4219-bb7e-d6271e5b4d3b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:08.793134 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dff57176-d5e8-4219-bb7e-d6271e5b4d3b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:08.793614 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dff57176-d5e8-4219-bb7e-d6271e5b4d3b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:08.794615 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dff57176-d5e8-4219-bb7e-d6271e5b4d3b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:08.795060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dff57176-d5e8-4219-bb7e-d6271e5b4d3b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:08.977901 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-dff57176-d5e8-4219-bb7e-d6271e5b4d3b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:08.986848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dff57176-d5e8-4219-bb7e-d6271e5b4d3b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.205532 Jul 21 17:48:08.987429 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 282/551] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:08 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:09.617427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-10358557-0267-4ce2-9086-adaf44ada3b6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:09.618452 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-10358557-0267-4ce2-9086-adaf44ada3b6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:09.625871 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10358557-0267-4ce2-9086-adaf44ada3b6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:09.626338 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10358557-0267-4ce2-9086-adaf44ada3b6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:09.627122 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10358557-0267-4ce2-9086-adaf44ada3b6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:09.627623 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10358557-0267-4ce2-9086-adaf44ada3b6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:09.658773 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-10358557-0267-4ce2-9086-adaf44ada3b6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045701 Jul 21 17:48:09.659515 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 270/552] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:10.003021 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-91f1918e-18ae-479f-bfca-a715654c4a8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:10.003637 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-91f1918e-18ae-479f-bfca-a715654c4a8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:10.010345 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-91f1918e-18ae-479f-bfca-a715654c4a8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:10.010797 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-91f1918e-18ae-479f-bfca-a715654c4a8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:10.011551 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-91f1918e-18ae-479f-bfca-a715654c4a8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:10.012014 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-91f1918e-18ae-479f-bfca-a715654c4a8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:10.141338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-91f1918e-18ae-479f-bfca-a715654c4a8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:10.149165 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-91f1918e-18ae-479f-bfca-a715654c4a8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149989 Jul 21 17:48:10.149727 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 283/553] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:09 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:10.670279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-096359a6-2c98-4656-a57a-5fb55cb6c9d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:10.671237 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-096359a6-2c98-4656-a57a-5fb55cb6c9d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:10.677647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-096359a6-2c98-4656-a57a-5fb55cb6c9d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:10.678093 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-096359a6-2c98-4656-a57a-5fb55cb6c9d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:10.678848 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-096359a6-2c98-4656-a57a-5fb55cb6c9d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:10.679291 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-096359a6-2c98-4656-a57a-5fb55cb6c9d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:10.708238 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-096359a6-2c98-4656-a57a-5fb55cb6c9d5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041864 Jul 21 17:48:10.708806 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 271/554] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:10 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:11.166853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e97ff735-1abf-492a-b87e-a4b7c3944390 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:11.167478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e97ff735-1abf-492a-b87e-a4b7c3944390 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:11.175634 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e97ff735-1abf-492a-b87e-a4b7c3944390 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:11.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e97ff735-1abf-492a-b87e-a4b7c3944390 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:11.176834 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e97ff735-1abf-492a-b87e-a4b7c3944390 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:11.177278 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e97ff735-1abf-492a-b87e-a4b7c3944390 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:11.311046 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e97ff735-1abf-492a-b87e-a4b7c3944390 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:11.319186 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e97ff735-1abf-492a-b87e-a4b7c3944390 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156431 Jul 21 17:48:11.319743 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 284/555] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:11 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:11.721129 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d243e18f-9b38-4ef9-a69e-1fc894c58f8d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:11.722070 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d243e18f-9b38-4ef9-a69e-1fc894c58f8d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:11.728522 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d243e18f-9b38-4ef9-a69e-1fc894c58f8d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:11.728988 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d243e18f-9b38-4ef9-a69e-1fc894c58f8d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:11.729760 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d243e18f-9b38-4ef9-a69e-1fc894c58f8d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:11.730203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d243e18f-9b38-4ef9-a69e-1fc894c58f8d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:11.758912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d243e18f-9b38-4ef9-a69e-1fc894c58f8d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041788 Jul 21 17:48:11.759454 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 272/556] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:11 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:12.337467 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6ced9bf3-c13c-4e0f-a6b2-eb5fa899d291 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:12.338048 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6ced9bf3-c13c-4e0f-a6b2-eb5fa899d291 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:12.345157 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ced9bf3-c13c-4e0f-a6b2-eb5fa899d291 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:12.345600 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ced9bf3-c13c-4e0f-a6b2-eb5fa899d291 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:12.346428 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ced9bf3-c13c-4e0f-a6b2-eb5fa899d291 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:12.346862 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ced9bf3-c13c-4e0f-a6b2-eb5fa899d291 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:12.495113 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6ced9bf3-c13c-4e0f-a6b2-eb5fa899d291 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:12.503665 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6ced9bf3-c13c-4e0f-a6b2-eb5fa899d291 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.170951 Jul 21 17:48:12.504230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 285/557] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:12 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:12.771786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0c557d7c-8afe-4a51-a77a-ca094ea4ada0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:12.772971 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0c557d7c-8afe-4a51-a77a-ca094ea4ada0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:12.779718 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c557d7c-8afe-4a51-a77a-ca094ea4ada0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:12.780161 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c557d7c-8afe-4a51-a77a-ca094ea4ada0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:12.781047 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c557d7c-8afe-4a51-a77a-ca094ea4ada0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:12.781475 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c557d7c-8afe-4a51-a77a-ca094ea4ada0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:12.813255 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0c557d7c-8afe-4a51-a77a-ca094ea4ada0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045875 Jul 21 17:48:12.813819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 273/558] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:12 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:13.521907 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ab022a08-c833-49a2-ac66-4674d31f4a68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:13.522450 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ab022a08-c833-49a2-ac66-4674d31f4a68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:13.529682 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ab022a08-c833-49a2-ac66-4674d31f4a68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:13.530130 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ab022a08-c833-49a2-ac66-4674d31f4a68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:13.530900 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ab022a08-c833-49a2-ac66-4674d31f4a68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:13.531339 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ab022a08-c833-49a2-ac66-4674d31f4a68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:13.661384 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ab022a08-c833-49a2-ac66-4674d31f4a68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:13.669322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ab022a08-c833-49a2-ac66-4674d31f4a68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151368 Jul 21 17:48:13.669891 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 286/559] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:13 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:13.826398 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b63a8e73-b815-4284-8cd8-3340cacef0a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:13.827329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b63a8e73-b815-4284-8cd8-3340cacef0a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:13.833829 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b63a8e73-b815-4284-8cd8-3340cacef0a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:13.834279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b63a8e73-b815-4284-8cd8-3340cacef0a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:13.835035 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b63a8e73-b815-4284-8cd8-3340cacef0a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:13.835641 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b63a8e73-b815-4284-8cd8-3340cacef0a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:13.864206 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b63a8e73-b815-4284-8cd8-3340cacef0a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042600 Jul 21 17:48:13.864786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 274/560] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:14.686833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-642e800e-07ec-45cd-b608-6758c09552fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:14.687443 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-642e800e-07ec-45cd-b608-6758c09552fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:14.694305 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-642e800e-07ec-45cd-b608-6758c09552fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:14.694754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-642e800e-07ec-45cd-b608-6758c09552fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:14.695517 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-642e800e-07ec-45cd-b608-6758c09552fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:14.695954 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-642e800e-07ec-45cd-b608-6758c09552fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:14.829057 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-642e800e-07ec-45cd-b608-6758c09552fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:14.837026 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-642e800e-07ec-45cd-b608-6758c09552fc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154535 Jul 21 17:48:14.837788 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 287/561] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:14 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:14.875090 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8d227561-9e2f-4c08-b007-3d3e92b5c87d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:14.876026 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8d227561-9e2f-4c08-b007-3d3e92b5c87d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:14.882432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d227561-9e2f-4c08-b007-3d3e92b5c87d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:14.882896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d227561-9e2f-4c08-b007-3d3e92b5c87d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:14.883666 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d227561-9e2f-4c08-b007-3d3e92b5c87d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:14.884110 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d227561-9e2f-4c08-b007-3d3e92b5c87d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:14.913341 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8d227561-9e2f-4c08-b007-3d3e92b5c87d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042336 Jul 21 17:48:14.913902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 275/562] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:14 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:15.854036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dfd70525-8a44-458b-ad3d-3a4bbea34e20 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:15.854710 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dfd70525-8a44-458b-ad3d-3a4bbea34e20 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:15.861820 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dfd70525-8a44-458b-ad3d-3a4bbea34e20 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:15.862277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dfd70525-8a44-458b-ad3d-3a4bbea34e20 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:15.863047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dfd70525-8a44-458b-ad3d-3a4bbea34e20 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:15.863491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dfd70525-8a44-458b-ad3d-3a4bbea34e20 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:15.925708 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-04e6f02f-bb6e-40fa-b44f-7a044af8ddcb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:15.926756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-04e6f02f-bb6e-40fa-b44f-7a044af8ddcb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:15.933847 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04e6f02f-bb6e-40fa-b44f-7a044af8ddcb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:15.934406 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04e6f02f-bb6e-40fa-b44f-7a044af8ddcb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:15.935886 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04e6f02f-bb6e-40fa-b44f-7a044af8ddcb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:15.936022 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04e6f02f-bb6e-40fa-b44f-7a044af8ddcb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:15.965427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-04e6f02f-bb6e-40fa-b44f-7a044af8ddcb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Jul 21 17:48:15.965985 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 276/563] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:15.992704 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-dfd70525-8a44-458b-ad3d-3a4bbea34e20 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:16.002342 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dfd70525-8a44-458b-ad3d-3a4bbea34e20 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152071 Jul 21 17:48:16.002923 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 288/564] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:15 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:16.977572 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-14e716c2-d8de-425c-aa27-97709179f39e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:16.978500 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-14e716c2-d8de-425c-aa27-97709179f39e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:16.985570 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14e716c2-d8de-425c-aa27-97709179f39e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:16.986017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14e716c2-d8de-425c-aa27-97709179f39e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:16.986795 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14e716c2-d8de-425c-aa27-97709179f39e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:16.987216 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14e716c2-d8de-425c-aa27-97709179f39e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:17.016090 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-14e716c2-d8de-425c-aa27-97709179f39e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 Jul 21 17:48:17.016671 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 277/565] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:16 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:17.019052 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d48fe564-9670-4eb4-ba2f-faef8fedd400 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:17.019662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d48fe564-9670-4eb4-ba2f-faef8fedd400 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:17.026109 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d48fe564-9670-4eb4-ba2f-faef8fedd400 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:17.026552 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d48fe564-9670-4eb4-ba2f-faef8fedd400 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:17.027310 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d48fe564-9670-4eb4-ba2f-faef8fedd400 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:17.027741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d48fe564-9670-4eb4-ba2f-faef8fedd400 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:17.164024 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d48fe564-9670-4eb4-ba2f-faef8fedd400 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:17.172633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d48fe564-9670-4eb4-ba2f-faef8fedd400 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.157412 Jul 21 17:48:17.173191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 289/566] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:17 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:48:18.027034 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d12ef70c-402d-4fad-9a33-1f8419b94b18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:18.028013 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d12ef70c-402d-4fad-9a33-1f8419b94b18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:18.035487 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d12ef70c-402d-4fad-9a33-1f8419b94b18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:18.035972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d12ef70c-402d-4fad-9a33-1f8419b94b18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:18.036781 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d12ef70c-402d-4fad-9a33-1f8419b94b18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:18.037220 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d12ef70c-402d-4fad-9a33-1f8419b94b18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:18.066393 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d12ef70c-402d-4fad-9a33-1f8419b94b18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043294 Jul 21 17:48:18.066934 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 278/567] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:18 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:18.190103 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-79e59698-5d2c-4ccb-a078-24fc0f622f92 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:18.190997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-79e59698-5d2c-4ccb-a078-24fc0f622f92 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:18.197501 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79e59698-5d2c-4ccb-a078-24fc0f622f92 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:18.197946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79e59698-5d2c-4ccb-a078-24fc0f622f92 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:18.198713 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79e59698-5d2c-4ccb-a078-24fc0f622f92 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:18.199147 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79e59698-5d2c-4ccb-a078-24fc0f622f92 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:18.326236 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-79e59698-5d2c-4ccb-a078-24fc0f622f92 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:18.334766 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-79e59698-5d2c-4ccb-a078-24fc0f622f92 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148987 Jul 21 17:48:18.335327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 290/568] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:18 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:19.078083 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1f8dbf91-c73f-4a50-b062-508ef315a9a9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:19.079001 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1f8dbf91-c73f-4a50-b062-508ef315a9a9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:19.085426 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f8dbf91-c73f-4a50-b062-508ef315a9a9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:19.085875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f8dbf91-c73f-4a50-b062-508ef315a9a9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:19.086635 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f8dbf91-c73f-4a50-b062-508ef315a9a9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:19.087067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f8dbf91-c73f-4a50-b062-508ef315a9a9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:19.115946 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1f8dbf91-c73f-4a50-b062-508ef315a9a9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041928 Jul 21 17:48:19.116510 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 279/569] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:19 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:19.351249 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8873c663-45bb-4d62-a2e0-186f9ccb3d5d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:19.351864 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8873c663-45bb-4d62-a2e0-186f9ccb3d5d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:19.358377 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8873c663-45bb-4d62-a2e0-186f9ccb3d5d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:19.359326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8873c663-45bb-4d62-a2e0-186f9ccb3d5d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:19.360250 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8873c663-45bb-4d62-a2e0-186f9ccb3d5d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:19.360714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8873c663-45bb-4d62-a2e0-186f9ccb3d5d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:19.491171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8873c663-45bb-4d62-a2e0-186f9ccb3d5d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:19.498875 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8873c663-45bb-4d62-a2e0-186f9ccb3d5d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151420 Jul 21 17:48:19.499618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 291/570] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:19 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:20.128964 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-82bb97e0-6e1e-435a-82d1-740a15825027 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:20.129899 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-82bb97e0-6e1e-435a-82d1-740a15825027 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:20.136545 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82bb97e0-6e1e-435a-82d1-740a15825027 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:20.137000 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82bb97e0-6e1e-435a-82d1-740a15825027 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:20.137767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82bb97e0-6e1e-435a-82d1-740a15825027 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:20.138203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82bb97e0-6e1e-435a-82d1-740a15825027 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:20.167417 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-82bb97e0-6e1e-435a-82d1-740a15825027 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043781 Jul 21 17:48:20.167970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 280/571] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:20 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:48:20.516700 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6cdd07e9-2a64-49e0-a8db-43e4b619f107 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:20.517246 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6cdd07e9-2a64-49e0-a8db-43e4b619f107 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:20.523693 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6cdd07e9-2a64-49e0-a8db-43e4b619f107 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:20.524156 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6cdd07e9-2a64-49e0-a8db-43e4b619f107 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:20.524966 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6cdd07e9-2a64-49e0-a8db-43e4b619f107 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:20.525409 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6cdd07e9-2a64-49e0-a8db-43e4b619f107 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:20.654823 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6cdd07e9-2a64-49e0-a8db-43e4b619f107 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:20.662951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6cdd07e9-2a64-49e0-a8db-43e4b619f107 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151019 Jul 21 17:48:20.663514 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 292/572] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:20 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:21.179094 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e059fa12-a062-48e9-96de-bb4def3fd4bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:21.180047 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e059fa12-a062-48e9-96de-bb4def3fd4bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:21.186503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e059fa12-a062-48e9-96de-bb4def3fd4bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:21.187380 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e059fa12-a062-48e9-96de-bb4def3fd4bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:21.188167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e059fa12-a062-48e9-96de-bb4def3fd4bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:21.188655 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e059fa12-a062-48e9-96de-bb4def3fd4bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:21.192674 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:48:21.222425 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e059fa12-a062-48e9-96de-bb4def3fd4bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047201 Jul 21 17:48:21.222997 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 281/573] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:21.679535 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5a473fe6-7f43-4714-ad0a-239acfb8a580 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:21.680157 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5a473fe6-7f43-4714-ad0a-239acfb8a580 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:21.686718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a473fe6-7f43-4714-ad0a-239acfb8a580 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:21.687241 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a473fe6-7f43-4714-ad0a-239acfb8a580 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:21.688049 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a473fe6-7f43-4714-ad0a-239acfb8a580 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:21.688524 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a473fe6-7f43-4714-ad0a-239acfb8a580 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:21.814970 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5a473fe6-7f43-4714-ad0a-239acfb8a580 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:21.823090 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5a473fe6-7f43-4714-ad0a-239acfb8a580 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147362 Jul 21 17:48:21.823652 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 293/574] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:21 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:22.234545 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f0704732-5c15-44f8-b83f-5c847aaedb58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:22.235444 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f0704732-5c15-44f8-b83f-5c847aaedb58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:22.241833 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0704732-5c15-44f8-b83f-5c847aaedb58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:22.242285 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0704732-5c15-44f8-b83f-5c847aaedb58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:22.243050 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0704732-5c15-44f8-b83f-5c847aaedb58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:22.243488 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0704732-5c15-44f8-b83f-5c847aaedb58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:22.272002 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f0704732-5c15-44f8-b83f-5c847aaedb58 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042012 Jul 21 17:48:22.272583 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 282/575] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:22 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:22.840611 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8540ebf9-de00-4403-bc4f-7922bb17f64a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:22.841223 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8540ebf9-de00-4403-bc4f-7922bb17f64a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:22.847902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8540ebf9-de00-4403-bc4f-7922bb17f64a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:22.848389 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8540ebf9-de00-4403-bc4f-7922bb17f64a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:22.849152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8540ebf9-de00-4403-bc4f-7922bb17f64a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:22.849585 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8540ebf9-de00-4403-bc4f-7922bb17f64a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:22.982706 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8540ebf9-de00-4403-bc4f-7922bb17f64a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:22.991372 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8540ebf9-de00-4403-bc4f-7922bb17f64a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154522 Jul 21 17:48:22.991930 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 294/576] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:22 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:23.283824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9f20d397-6123-4fdc-b0ab-8b2576593f02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:23.284707 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9f20d397-6123-4fdc-b0ab-8b2576593f02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:23.291152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f20d397-6123-4fdc-b0ab-8b2576593f02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:23.291609 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f20d397-6123-4fdc-b0ab-8b2576593f02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:23.292412 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f20d397-6123-4fdc-b0ab-8b2576593f02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:23.292857 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f20d397-6123-4fdc-b0ab-8b2576593f02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:23.321371 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9f20d397-6123-4fdc-b0ab-8b2576593f02 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042118 Jul 21 17:48:23.321923 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 283/577] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:23 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:24.013633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-db4d49a9-91f2-4302-ad32-c877b7c0a2ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:24.014243 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-db4d49a9-91f2-4302-ad32-c877b7c0a2ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:24.021350 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db4d49a9-91f2-4302-ad32-c877b7c0a2ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:24.021799 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db4d49a9-91f2-4302-ad32-c877b7c0a2ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:24.022573 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db4d49a9-91f2-4302-ad32-c877b7c0a2ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:24.022992 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db4d49a9-91f2-4302-ad32-c877b7c0a2ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:24.151558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-db4d49a9-91f2-4302-ad32-c877b7c0a2ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:24.153755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=100 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:48:24.160782 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-db4d49a9-91f2-4302-ad32-c877b7c0a2ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150985 Jul 21 17:48:24.161338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 295/578] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:24 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:24.333459 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a9f5e521-f914-4a8d-8549-e2e1dd8b4630 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:24.334305 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a9f5e521-f914-4a8d-8549-e2e1dd8b4630 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:24.340874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9f5e521-f914-4a8d-8549-e2e1dd8b4630 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:24.341327 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9f5e521-f914-4a8d-8549-e2e1dd8b4630 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:24.342093 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9f5e521-f914-4a8d-8549-e2e1dd8b4630 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:24.342533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9f5e521-f914-4a8d-8549-e2e1dd8b4630 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:24.370787 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a9f5e521-f914-4a8d-8549-e2e1dd8b4630 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041292 Jul 21 17:48:24.376738 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 284/579] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:24 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:25.178406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3c220bb8-be9f-45b6-a9f3-6195abe42c40 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:25.179019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3c220bb8-be9f-45b6-a9f3-6195abe42c40 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:25.185725 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3c220bb8-be9f-45b6-a9f3-6195abe42c40 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:25.186177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3c220bb8-be9f-45b6-a9f3-6195abe42c40 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:25.186931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3c220bb8-be9f-45b6-a9f3-6195abe42c40 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:25.187678 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3c220bb8-be9f-45b6-a9f3-6195abe42c40 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:25.339719 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3c220bb8-be9f-45b6-a9f3-6195abe42c40 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:25.348245 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3c220bb8-be9f-45b6-a9f3-6195abe42c40 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.173916 Jul 21 17:48:25.348834 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 296/580] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:25 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:25.382319 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dd1f0f1c-f55a-4e6a-b067-3e88cff862c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:25.383244 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dd1f0f1c-f55a-4e6a-b067-3e88cff862c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:25.389680 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd1f0f1c-f55a-4e6a-b067-3e88cff862c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:25.390126 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd1f0f1c-f55a-4e6a-b067-3e88cff862c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:25.391492 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd1f0f1c-f55a-4e6a-b067-3e88cff862c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:25.391929 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd1f0f1c-f55a-4e6a-b067-3e88cff862c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:25.422067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dd1f0f1c-f55a-4e6a-b067-3e88cff862c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043572 Jul 21 17:48:25.422854 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 285/581] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:25 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:26.365651 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9ed39583-308a-4df2-806c-15f2c6e1248f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:26.366291 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9ed39583-308a-4df2-806c-15f2c6e1248f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:26.373036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9ed39583-308a-4df2-806c-15f2c6e1248f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:26.373484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9ed39583-308a-4df2-806c-15f2c6e1248f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:26.374274 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9ed39583-308a-4df2-806c-15f2c6e1248f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:26.375235 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9ed39583-308a-4df2-806c-15f2c6e1248f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:26.433606 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-521ecf87-02d0-494d-ba2e-9e413f64282c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:26.434714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-521ecf87-02d0-494d-ba2e-9e413f64282c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:26.442094 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-521ecf87-02d0-494d-ba2e-9e413f64282c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:26.442534 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-521ecf87-02d0-494d-ba2e-9e413f64282c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:26.443306 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-521ecf87-02d0-494d-ba2e-9e413f64282c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:26.443735 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-521ecf87-02d0-494d-ba2e-9e413f64282c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:26.473142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-521ecf87-02d0-494d-ba2e-9e413f64282c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043472 Jul 21 17:48:26.473901 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 286/582] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:26 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:48:26.506344 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9ed39583-308a-4df2-806c-15f2c6e1248f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:26.514379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9ed39583-308a-4df2-806c-15f2c6e1248f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152658 Jul 21 17:48:26.514938 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 297/583] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:26 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:27.485441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3ce5b25c-8638-4d54-ab25-c2d8f2076bc1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:27.486370 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3ce5b25c-8638-4d54-ab25-c2d8f2076bc1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:27.492856 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ce5b25c-8638-4d54-ab25-c2d8f2076bc1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:27.493313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ce5b25c-8638-4d54-ab25-c2d8f2076bc1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:27.494078 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ce5b25c-8638-4d54-ab25-c2d8f2076bc1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:27.494519 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ce5b25c-8638-4d54-ab25-c2d8f2076bc1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:27.524057 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3ce5b25c-8638-4d54-ab25-c2d8f2076bc1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042690 Jul 21 17:48:27.524912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 287/584] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:27 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:27.530828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4b082a7b-ceb9-4c9e-9c0b-6ddc76e685e4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:27.532791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4b082a7b-ceb9-4c9e-9c0b-6ddc76e685e4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:27.538939 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4b082a7b-ceb9-4c9e-9c0b-6ddc76e685e4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:27.539394 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4b082a7b-ceb9-4c9e-9c0b-6ddc76e685e4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:27.540169 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4b082a7b-ceb9-4c9e-9c0b-6ddc76e685e4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:27.540635 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4b082a7b-ceb9-4c9e-9c0b-6ddc76e685e4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:27.675518 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4b082a7b-ceb9-4c9e-9c0b-6ddc76e685e4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:27.683518 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4b082a7b-ceb9-4c9e-9c0b-6ddc76e685e4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156614 Jul 21 17:48:27.684089 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 298/585] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:27 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:28.535851 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-04c7184f-b33f-4a76-842f-5bbccb248811 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:28.536819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-04c7184f-b33f-4a76-842f-5bbccb248811 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:28.543474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04c7184f-b33f-4a76-842f-5bbccb248811 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:28.543955 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04c7184f-b33f-4a76-842f-5bbccb248811 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:28.544778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04c7184f-b33f-4a76-842f-5bbccb248811 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:28.545252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04c7184f-b33f-4a76-842f-5bbccb248811 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:28.575500 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-04c7184f-b33f-4a76-842f-5bbccb248811 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 Jul 21 17:48:28.576064 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 288/586] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:28 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:28.700950 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a747892a-9e5b-41ed-9beb-b663eaf76d7b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:28.701561 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a747892a-9e5b-41ed-9beb-b663eaf76d7b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:28.707947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a747892a-9e5b-41ed-9beb-b663eaf76d7b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:28.708436 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a747892a-9e5b-41ed-9beb-b663eaf76d7b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:28.709192 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a747892a-9e5b-41ed-9beb-b663eaf76d7b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:28.709626 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a747892a-9e5b-41ed-9beb-b663eaf76d7b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:28.837496 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a747892a-9e5b-41ed-9beb-b663eaf76d7b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:28.845826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a747892a-9e5b-41ed-9beb-b663eaf76d7b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148619 Jul 21 17:48:28.846406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 299/587] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:28 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:29.587110 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-98151fed-05ef-4d44-8c6b-15f413f1250f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:29.588047 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-98151fed-05ef-4d44-8c6b-15f413f1250f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:29.594751 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-98151fed-05ef-4d44-8c6b-15f413f1250f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:29.595207 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-98151fed-05ef-4d44-8c6b-15f413f1250f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:29.595982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-98151fed-05ef-4d44-8c6b-15f413f1250f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:29.596467 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-98151fed-05ef-4d44-8c6b-15f413f1250f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:29.625639 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-98151fed-05ef-4d44-8c6b-15f413f1250f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042464 Jul 21 17:48:29.626244 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 289/588] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:29 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:29.862315 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-92376bf6-0848-462c-b976-b7ef54fb56e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:29.862859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-92376bf6-0848-462c-b976-b7ef54fb56e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:29.869259 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92376bf6-0848-462c-b976-b7ef54fb56e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:29.869705 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92376bf6-0848-462c-b976-b7ef54fb56e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:29.870463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92376bf6-0848-462c-b976-b7ef54fb56e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:29.870894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92376bf6-0848-462c-b976-b7ef54fb56e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:29.998558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-92376bf6-0848-462c-b976-b7ef54fb56e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:30.007402 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-92376bf6-0848-462c-b976-b7ef54fb56e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149486 Jul 21 17:48:30.007979 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 300/589] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:29 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:30.637315 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a2551870-da39-49eb-b7eb-a3a36b155fd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:30.638155 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a2551870-da39-49eb-b7eb-a3a36b155fd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:30.645310 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2551870-da39-49eb-b7eb-a3a36b155fd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:30.645759 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2551870-da39-49eb-b7eb-a3a36b155fd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:30.646516 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2551870-da39-49eb-b7eb-a3a36b155fd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:30.646948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2551870-da39-49eb-b7eb-a3a36b155fd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:30.676040 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a2551870-da39-49eb-b7eb-a3a36b155fd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042748 Jul 21 17:48:30.676636 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 290/590] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:30 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:31.024606 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-aca0b304-ef01-4f8d-bdf4-9d0f94275049 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:31.025305 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-aca0b304-ef01-4f8d-bdf4-9d0f94275049 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:31.031763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aca0b304-ef01-4f8d-bdf4-9d0f94275049 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:31.032245 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aca0b304-ef01-4f8d-bdf4-9d0f94275049 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:31.033239 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aca0b304-ef01-4f8d-bdf4-9d0f94275049 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:31.033677 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aca0b304-ef01-4f8d-bdf4-9d0f94275049 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:31.164685 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-aca0b304-ef01-4f8d-bdf4-9d0f94275049 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:31.173328 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-aca0b304-ef01-4f8d-bdf4-9d0f94275049 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152107 Jul 21 17:48:31.173897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 301/591] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:31 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:31.687603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0cc0ca08-1125-410e-9048-bf56ea3cb5cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:31.689183 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0cc0ca08-1125-410e-9048-bf56ea3cb5cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:31.695535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0cc0ca08-1125-410e-9048-bf56ea3cb5cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:31.695982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0cc0ca08-1125-410e-9048-bf56ea3cb5cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:31.696769 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0cc0ca08-1125-410e-9048-bf56ea3cb5cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:31.697202 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0cc0ca08-1125-410e-9048-bf56ea3cb5cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:31.726252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0cc0ca08-1125-410e-9048-bf56ea3cb5cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042580 Jul 21 17:48:31.726814 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 291/592] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:32.189662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6d700343-5e1b-441b-9ee5-bc5fe77beeef tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:32.190277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6d700343-5e1b-441b-9ee5-bc5fe77beeef tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:32.197249 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d700343-5e1b-441b-9ee5-bc5fe77beeef tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:32.197705 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d700343-5e1b-441b-9ee5-bc5fe77beeef tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:32.198503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d700343-5e1b-441b-9ee5-bc5fe77beeef tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:32.198941 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d700343-5e1b-441b-9ee5-bc5fe77beeef tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:32.327492 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6d700343-5e1b-441b-9ee5-bc5fe77beeef tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:32.335912 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6d700343-5e1b-441b-9ee5-bc5fe77beeef tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150058 Jul 21 17:48:32.336506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 302/593] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:32 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:32.738536 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-61825292-8699-4c1a-91ab-647dc51fa7b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:32.739470 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-61825292-8699-4c1a-91ab-647dc51fa7b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:32.746010 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61825292-8699-4c1a-91ab-647dc51fa7b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:32.746467 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61825292-8699-4c1a-91ab-647dc51fa7b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:32.747240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61825292-8699-4c1a-91ab-647dc51fa7b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:32.747713 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61825292-8699-4c1a-91ab-647dc51fa7b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:32.776998 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-61825292-8699-4c1a-91ab-647dc51fa7b8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043130 Jul 21 17:48:32.777564 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 292/594] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:32 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:33.352961 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8f06ce32-12ab-4f21-b0af-d008d71ee20e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:33.353570 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8f06ce32-12ab-4f21-b0af-d008d71ee20e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:33.360570 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8f06ce32-12ab-4f21-b0af-d008d71ee20e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:33.361060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8f06ce32-12ab-4f21-b0af-d008d71ee20e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:33.361818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8f06ce32-12ab-4f21-b0af-d008d71ee20e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:33.362255 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8f06ce32-12ab-4f21-b0af-d008d71ee20e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:33.490957 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8f06ce32-12ab-4f21-b0af-d008d71ee20e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:33.498882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8f06ce32-12ab-4f21-b0af-d008d71ee20e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149745 Jul 21 17:48:33.499445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 303/595] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:33 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:33.789503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e604510f-a257-4951-9dc1-5629d02dae56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:33.790357 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e604510f-a257-4951-9dc1-5629d02dae56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:33.792670 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:48:33.798517 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e604510f-a257-4951-9dc1-5629d02dae56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:33.798971 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e604510f-a257-4951-9dc1-5629d02dae56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:33.799747 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e604510f-a257-4951-9dc1-5629d02dae56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:33.800190 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e604510f-a257-4951-9dc1-5629d02dae56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:33.832826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e604510f-a257-4951-9dc1-5629d02dae56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047236 Jul 21 17:48:33.833399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 293/596] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:33 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:34.516087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-72574b4a-1e80-492a-9d3d-69fbb5c4af87 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:34.517097 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-72574b4a-1e80-492a-9d3d-69fbb5c4af87 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:34.519375 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=50 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:48:34.527420 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-72574b4a-1e80-492a-9d3d-69fbb5c4af87 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:34.527868 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-72574b4a-1e80-492a-9d3d-69fbb5c4af87 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:34.528668 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-72574b4a-1e80-492a-9d3d-69fbb5c4af87 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:34.529105 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-72574b4a-1e80-492a-9d3d-69fbb5c4af87 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:34.663007 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-72574b4a-1e80-492a-9d3d-69fbb5c4af87 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:34.670883 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-72574b4a-1e80-492a-9d3d-69fbb5c4af87 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.158723 Jul 21 17:48:34.671445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 304/597] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:34 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:34.845016 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-98353bce-ce9b-491a-8010-f0772f4e8437 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:34.845985 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-98353bce-ce9b-491a-8010-f0772f4e8437 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:34.852443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-98353bce-ce9b-491a-8010-f0772f4e8437 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:34.852890 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-98353bce-ce9b-491a-8010-f0772f4e8437 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:34.853654 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-98353bce-ce9b-491a-8010-f0772f4e8437 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:34.854087 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-98353bce-ce9b-491a-8010-f0772f4e8437 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:34.883275 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-98353bce-ce9b-491a-8010-f0772f4e8437 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042758 Jul 21 17:48:34.883841 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 294/598] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:34 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:35.689193 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-22dd1568-bb30-4f36-a13e-1e3aac76eb24 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:35.689809 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-22dd1568-bb30-4f36-a13e-1e3aac76eb24 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:35.696756 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-22dd1568-bb30-4f36-a13e-1e3aac76eb24 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:35.697209 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-22dd1568-bb30-4f36-a13e-1e3aac76eb24 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:35.697974 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-22dd1568-bb30-4f36-a13e-1e3aac76eb24 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:35.698412 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-22dd1568-bb30-4f36-a13e-1e3aac76eb24 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:35.827530 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-22dd1568-bb30-4f36-a13e-1e3aac76eb24 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:35.835538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-22dd1568-bb30-4f36-a13e-1e3aac76eb24 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150841 Jul 21 17:48:35.836095 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 305/599] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:35 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:35.895058 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-edc667e3-0989-4b22-8cab-54ce51829c56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:35.895984 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-edc667e3-0989-4b22-8cab-54ce51829c56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:35.902509 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-edc667e3-0989-4b22-8cab-54ce51829c56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:35.902961 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-edc667e3-0989-4b22-8cab-54ce51829c56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:35.903725 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-edc667e3-0989-4b22-8cab-54ce51829c56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:35.904164 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-edc667e3-0989-4b22-8cab-54ce51829c56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:35.934309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-edc667e3-0989-4b22-8cab-54ce51829c56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043328 Jul 21 17:48:35.935281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 295/600] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:35 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:36.852415 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-10858b6a-f88f-42bc-b3ac-59dec8dc3c37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:36.853025 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-10858b6a-f88f-42bc-b3ac-59dec8dc3c37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:36.859424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-10858b6a-f88f-42bc-b3ac-59dec8dc3c37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:36.859891 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-10858b6a-f88f-42bc-b3ac-59dec8dc3c37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:36.860717 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-10858b6a-f88f-42bc-b3ac-59dec8dc3c37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:36.861149 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-10858b6a-f88f-42bc-b3ac-59dec8dc3c37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:36.946880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d88e6c19-a147-4bbe-ae7d-8545bad2daa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:36.947837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d88e6c19-a147-4bbe-ae7d-8545bad2daa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:36.955156 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d88e6c19-a147-4bbe-ae7d-8545bad2daa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:36.955605 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d88e6c19-a147-4bbe-ae7d-8545bad2daa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:36.956397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d88e6c19-a147-4bbe-ae7d-8545bad2daa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:36.956836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d88e6c19-a147-4bbe-ae7d-8545bad2daa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:36.986812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d88e6c19-a147-4bbe-ae7d-8545bad2daa9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043786 Jul 21 17:48:36.987703 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 296/601] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:36 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:36.993410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-10858b6a-f88f-42bc-b3ac-59dec8dc3c37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:37.002506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-10858b6a-f88f-42bc-b3ac-59dec8dc3c37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153789 Jul 21 17:48:37.003814 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 306/602] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:36 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:37.998569 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ef7c07c3-7f13-4de0-92ed-1a1de2a472a1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:37.999483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ef7c07c3-7f13-4de0-92ed-1a1de2a472a1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:38.005910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef7c07c3-7f13-4de0-92ed-1a1de2a472a1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:38.006364 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef7c07c3-7f13-4de0-92ed-1a1de2a472a1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:38.007130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef7c07c3-7f13-4de0-92ed-1a1de2a472a1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:38.007566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef7c07c3-7f13-4de0-92ed-1a1de2a472a1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:38.022739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-904ca273-df85-43b0-9595-435afb0deca8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:38.023361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-904ca273-df85-43b0-9595-435afb0deca8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:38.029756 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-904ca273-df85-43b0-9595-435afb0deca8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:38.030212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-904ca273-df85-43b0-9595-435afb0deca8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:38.030991 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-904ca273-df85-43b0-9595-435afb0deca8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:38.031432 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-904ca273-df85-43b0-9595-435afb0deca8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:38.034514 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:48:38.040414 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ef7c07c3-7f13-4de0-92ed-1a1de2a472a1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045794 Jul 21 17:48:38.040993 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 297/603] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:37 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:38.163780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-904ca273-df85-43b0-9595-435afb0deca8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:38.171633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-904ca273-df85-43b0-9595-435afb0deca8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152895 Jul 21 17:48:38.172191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 307/604] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:38 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:48:39.052040 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-02c82ec9-2a2a-499c-8a46-ce0e5dc3feee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:39.053042 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-02c82ec9-2a2a-499c-8a46-ce0e5dc3feee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:39.059661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02c82ec9-2a2a-499c-8a46-ce0e5dc3feee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:39.060118 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02c82ec9-2a2a-499c-8a46-ce0e5dc3feee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:39.060960 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02c82ec9-2a2a-499c-8a46-ce0e5dc3feee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:39.061408 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02c82ec9-2a2a-499c-8a46-ce0e5dc3feee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:39.091534 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-02c82ec9-2a2a-499c-8a46-ce0e5dc3feee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044303 Jul 21 17:48:39.092087 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 298/605] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:39 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:39.189759 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7d95a9f8-f8c5-4820-9d62-d895b7089de6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:39.190298 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7d95a9f8-f8c5-4820-9d62-d895b7089de6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:39.196987 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d95a9f8-f8c5-4820-9d62-d895b7089de6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:39.197433 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d95a9f8-f8c5-4820-9d62-d895b7089de6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:39.198188 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d95a9f8-f8c5-4820-9d62-d895b7089de6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:39.198620 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d95a9f8-f8c5-4820-9d62-d895b7089de6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:39.329090 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7d95a9f8-f8c5-4820-9d62-d895b7089de6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:39.336875 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7d95a9f8-f8c5-4820-9d62-d895b7089de6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151673 Jul 21 17:48:39.337432 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 308/606] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:39 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:40.102910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-11ec8982-8866-4394-84b7-11ae769f4e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:40.103765 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-11ec8982-8866-4394-84b7-11ae769f4e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:40.110392 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11ec8982-8866-4394-84b7-11ae769f4e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:40.110833 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11ec8982-8866-4394-84b7-11ae769f4e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:40.111605 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11ec8982-8866-4394-84b7-11ae769f4e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:40.112052 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11ec8982-8866-4394-84b7-11ae769f4e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:40.143853 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-11ec8982-8866-4394-84b7-11ae769f4e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Jul 21 17:48:40.144457 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 299/607] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:40.354300 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c23e66c2-8b06-4bc5-9cd6-6862c18c619f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:40.354844 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c23e66c2-8b06-4bc5-9cd6-6862c18c619f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:40.362296 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c23e66c2-8b06-4bc5-9cd6-6862c18c619f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:40.362753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c23e66c2-8b06-4bc5-9cd6-6862c18c619f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:40.363530 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c23e66c2-8b06-4bc5-9cd6-6862c18c619f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:40.363977 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c23e66c2-8b06-4bc5-9cd6-6862c18c619f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:40.494628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c23e66c2-8b06-4bc5-9cd6-6862c18c619f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:40.503256 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c23e66c2-8b06-4bc5-9cd6-6862c18c619f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152845 Jul 21 17:48:40.503821 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 309/608] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:40 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:41.155010 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ffd574ef-e636-4995-9412-8f15296567ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:41.155932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ffd574ef-e636-4995-9412-8f15296567ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:41.163118 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffd574ef-e636-4995-9412-8f15296567ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:41.163585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffd574ef-e636-4995-9412-8f15296567ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:41.164374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffd574ef-e636-4995-9412-8f15296567ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:41.164811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffd574ef-e636-4995-9412-8f15296567ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:41.196458 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ffd574ef-e636-4995-9412-8f15296567ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Jul 21 17:48:41.197033 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 300/609] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:41 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:41.520128 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-399f19e0-e6aa-4dbf-84b3-85d6538a60af tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:41.520995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-399f19e0-e6aa-4dbf-84b3-85d6538a60af tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:41.527499 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-399f19e0-e6aa-4dbf-84b3-85d6538a60af tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:41.527947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-399f19e0-e6aa-4dbf-84b3-85d6538a60af tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:41.528739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-399f19e0-e6aa-4dbf-84b3-85d6538a60af tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:41.529173 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-399f19e0-e6aa-4dbf-84b3-85d6538a60af tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:41.672943 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-399f19e0-e6aa-4dbf-84b3-85d6538a60af tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:41.680979 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-399f19e0-e6aa-4dbf-84b3-85d6538a60af tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.165178 Jul 21 17:48:41.681541 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 310/610] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:41 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:42.207585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b51d326b-9e18-4bb8-847c-a8ebe325344e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:42.208470 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b51d326b-9e18-4bb8-847c-a8ebe325344e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:42.214953 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b51d326b-9e18-4bb8-847c-a8ebe325344e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:42.215389 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b51d326b-9e18-4bb8-847c-a8ebe325344e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:42.216148 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b51d326b-9e18-4bb8-847c-a8ebe325344e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:42.216608 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b51d326b-9e18-4bb8-847c-a8ebe325344e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:42.246396 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b51d326b-9e18-4bb8-847c-a8ebe325344e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042754 Jul 21 17:48:42.246947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 301/611] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:42 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:42.698715 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-14657719-ea9f-435e-a0c7-40ded77b85e5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:42.699327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-14657719-ea9f-435e-a0c7-40ded77b85e5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:42.706627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-14657719-ea9f-435e-a0c7-40ded77b85e5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:42.707079 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-14657719-ea9f-435e-a0c7-40ded77b85e5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:42.707849 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-14657719-ea9f-435e-a0c7-40ded77b85e5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:42.708277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-14657719-ea9f-435e-a0c7-40ded77b85e5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:42.834619 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-14657719-ea9f-435e-a0c7-40ded77b85e5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:42.842396 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-14657719-ea9f-435e-a0c7-40ded77b85e5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147530 Jul 21 17:48:42.842961 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 311/612] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:42 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:43.258070 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-52ccd5d6-768b-43e5-b6a1-ea971e2f16a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:43.259001 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-52ccd5d6-768b-43e5-b6a1-ea971e2f16a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:43.265490 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-52ccd5d6-768b-43e5-b6a1-ea971e2f16a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:43.265982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-52ccd5d6-768b-43e5-b6a1-ea971e2f16a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:43.266792 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-52ccd5d6-768b-43e5-b6a1-ea971e2f16a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:43.267270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-52ccd5d6-768b-43e5-b6a1-ea971e2f16a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:43.296567 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-52ccd5d6-768b-43e5-b6a1-ea971e2f16a3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042389 Jul 21 17:48:43.297142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 302/613] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:43.858632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-15c30dfc-43e8-49d5-85db-b7c381f607eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:43.859185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-15c30dfc-43e8-49d5-85db-b7c381f607eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:43.866283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-15c30dfc-43e8-49d5-85db-b7c381f607eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:43.866742 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-15c30dfc-43e8-49d5-85db-b7c381f607eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:43.867514 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-15c30dfc-43e8-49d5-85db-b7c381f607eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:43.867994 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-15c30dfc-43e8-49d5-85db-b7c381f607eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:43.882459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=100 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:48:43.995910 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-15c30dfc-43e8-49d5-85db-b7c381f607eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:44.004382 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-15c30dfc-43e8-49d5-85db-b7c381f607eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149613 Jul 21 17:48:44.004944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 312/614] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:43 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:44.308783 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f2ed5fa7-effa-45de-ab77-1fc24162c0ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:44.309720 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f2ed5fa7-effa-45de-ab77-1fc24162c0ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:44.317387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2ed5fa7-effa-45de-ab77-1fc24162c0ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:44.317841 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2ed5fa7-effa-45de-ab77-1fc24162c0ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:44.318625 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2ed5fa7-effa-45de-ab77-1fc24162c0ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:44.319063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2ed5fa7-effa-45de-ab77-1fc24162c0ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:44.349350 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f2ed5fa7-effa-45de-ab77-1fc24162c0ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044427 Jul 21 17:48:44.349841 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 303/615] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:44 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:45.020399 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f85fa606-15e7-4829-8f20-3d41f8479bc8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:45.021016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f85fa606-15e7-4829-8f20-3d41f8479bc8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:45.027520 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f85fa606-15e7-4829-8f20-3d41f8479bc8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:45.027989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f85fa606-15e7-4829-8f20-3d41f8479bc8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:45.028785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f85fa606-15e7-4829-8f20-3d41f8479bc8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:45.029225 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f85fa606-15e7-4829-8f20-3d41f8479bc8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:45.164703 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f85fa606-15e7-4829-8f20-3d41f8479bc8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:45.173764 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f85fa606-15e7-4829-8f20-3d41f8479bc8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156058 Jul 21 17:48:45.174360 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 313/616] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:45 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:45.361563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a7f09ff6-cfa6-4645-8b87-d302fdcc4050 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:45.362435 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a7f09ff6-cfa6-4645-8b87-d302fdcc4050 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:45.368931 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a7f09ff6-cfa6-4645-8b87-d302fdcc4050 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:45.369380 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a7f09ff6-cfa6-4645-8b87-d302fdcc4050 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:45.370136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a7f09ff6-cfa6-4645-8b87-d302fdcc4050 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:45.370570 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a7f09ff6-cfa6-4645-8b87-d302fdcc4050 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:45.400404 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a7f09ff6-cfa6-4645-8b87-d302fdcc4050 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Jul 21 17:48:45.401006 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 304/617] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:45 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:46.191606 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5e6d8853-84a6-491b-90ea-9f14f6565d0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:46.192226 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5e6d8853-84a6-491b-90ea-9f14f6565d0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:46.198927 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5e6d8853-84a6-491b-90ea-9f14f6565d0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:46.199378 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5e6d8853-84a6-491b-90ea-9f14f6565d0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:46.200150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5e6d8853-84a6-491b-90ea-9f14f6565d0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:46.200622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5e6d8853-84a6-491b-90ea-9f14f6565d0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:46.326727 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5e6d8853-84a6-491b-90ea-9f14f6565d0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:46.334993 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5e6d8853-84a6-491b-90ea-9f14f6565d0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148084 Jul 21 17:48:46.335575 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 314/618] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:46 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:46.411145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f887edf9-da53-416b-ac5e-50f8f19afe98 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:46.412078 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f887edf9-da53-416b-ac5e-50f8f19afe98 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:46.418611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f887edf9-da53-416b-ac5e-50f8f19afe98 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:46.419072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f887edf9-da53-416b-ac5e-50f8f19afe98 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:46.419900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f887edf9-da53-416b-ac5e-50f8f19afe98 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:46.420316 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f887edf9-da53-416b-ac5e-50f8f19afe98 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:46.452034 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f887edf9-da53-416b-ac5e-50f8f19afe98 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044893 Jul 21 17:48:46.452652 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 305/619] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:46 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:47.352472 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b36f67d4-0bcf-44a9-9e0d-fc2aa68660c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:47.353089 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b36f67d4-0bcf-44a9-9e0d-fc2aa68660c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:47.359446 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b36f67d4-0bcf-44a9-9e0d-fc2aa68660c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:47.359890 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b36f67d4-0bcf-44a9-9e0d-fc2aa68660c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:47.360679 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b36f67d4-0bcf-44a9-9e0d-fc2aa68660c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:47.361784 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b36f67d4-0bcf-44a9-9e0d-fc2aa68660c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:47.463052 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cdb0b665-bf04-4514-ba7c-5b7c7b8223ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:47.464104 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cdb0b665-bf04-4514-ba7c-5b7c7b8223ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:47.472399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cdb0b665-bf04-4514-ba7c-5b7c7b8223ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:47.472894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cdb0b665-bf04-4514-ba7c-5b7c7b8223ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:47.473676 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cdb0b665-bf04-4514-ba7c-5b7c7b8223ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:47.474123 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cdb0b665-bf04-4514-ba7c-5b7c7b8223ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:47.496162 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b36f67d4-0bcf-44a9-9e0d-fc2aa68660c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:47.506126 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b36f67d4-0bcf-44a9-9e0d-fc2aa68660c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.157322 Jul 21 17:48:47.506461 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cdb0b665-bf04-4514-ba7c-5b7c7b8223ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047332 Jul 21 17:48:47.506838 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 315/620] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:47 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:47.507160 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 306/621] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:48:48.518826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-55efd28e-e639-4bd0-b9f1-2367f209de88 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:48.520093 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-55efd28e-e639-4bd0-b9f1-2367f209de88 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:48.523079 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b2720335-15e2-431f-9cf0-8802786fc062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:48.523665 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b2720335-15e2-431f-9cf0-8802786fc062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:48.526947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-55efd28e-e639-4bd0-b9f1-2367f209de88 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:48.527404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-55efd28e-e639-4bd0-b9f1-2367f209de88 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:48.528182 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-55efd28e-e639-4bd0-b9f1-2367f209de88 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:48.528659 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-55efd28e-e639-4bd0-b9f1-2367f209de88 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:48.529906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2720335-15e2-431f-9cf0-8802786fc062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:48.530367 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2720335-15e2-431f-9cf0-8802786fc062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:48.531142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2720335-15e2-431f-9cf0-8802786fc062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:48.531588 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2720335-15e2-431f-9cf0-8802786fc062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:48.559341 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-55efd28e-e639-4bd0-b9f1-2367f209de88 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045047 Jul 21 17:48:48.559922 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 316/622] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:48 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:48.716415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b2720335-15e2-431f-9cf0-8802786fc062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:48.725149 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b2720335-15e2-431f-9cf0-8802786fc062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.205842 Jul 21 17:48:48.725719 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 307/623] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:48 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:48:49.571407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b22546f5-6a3d-48ea-8a39-c6b7ab88af7b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:49.572362 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b22546f5-6a3d-48ea-8a39-c6b7ab88af7b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:49.578896 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b22546f5-6a3d-48ea-8a39-c6b7ab88af7b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:49.579345 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b22546f5-6a3d-48ea-8a39-c6b7ab88af7b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:49.580110 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b22546f5-6a3d-48ea-8a39-c6b7ab88af7b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:49.580660 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b22546f5-6a3d-48ea-8a39-c6b7ab88af7b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:49.609927 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b22546f5-6a3d-48ea-8a39-c6b7ab88af7b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042393 Jul 21 17:48:49.610478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 317/624] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:49 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:49.742990 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2df8ec9e-27ae-449b-8139-96b215b4e0b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:49.743608 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2df8ec9e-27ae-449b-8139-96b215b4e0b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:49.750097 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2df8ec9e-27ae-449b-8139-96b215b4e0b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:49.750546 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2df8ec9e-27ae-449b-8139-96b215b4e0b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:49.751311 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2df8ec9e-27ae-449b-8139-96b215b4e0b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:49.751876 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2df8ec9e-27ae-449b-8139-96b215b4e0b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:49.878543 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2df8ec9e-27ae-449b-8139-96b215b4e0b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:49.886381 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2df8ec9e-27ae-449b-8139-96b215b4e0b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147373 Jul 21 17:48:49.886945 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 308/625] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:49 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:50.621936 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5c81aaab-4acd-45a4-bde4-c0cf2f1ec450 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:50.622869 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5c81aaab-4acd-45a4-bde4-c0cf2f1ec450 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:50.629661 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c81aaab-4acd-45a4-bde4-c0cf2f1ec450 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:50.630125 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c81aaab-4acd-45a4-bde4-c0cf2f1ec450 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:50.630905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c81aaab-4acd-45a4-bde4-c0cf2f1ec450 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:50.631343 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c81aaab-4acd-45a4-bde4-c0cf2f1ec450 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:50.662123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5c81aaab-4acd-45a4-bde4-c0cf2f1ec450 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Jul 21 17:48:50.662923 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 318/626] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:50 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:50.903447 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d9b9bc07-b27c-4df8-ac21-b4d5be085afb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:50.903989 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d9b9bc07-b27c-4df8-ac21-b4d5be085afb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:50.911650 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9b9bc07-b27c-4df8-ac21-b4d5be085afb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:50.912101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9b9bc07-b27c-4df8-ac21-b4d5be085afb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:50.912904 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9b9bc07-b27c-4df8-ac21-b4d5be085afb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:50.913378 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9b9bc07-b27c-4df8-ac21-b4d5be085afb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:51.046354 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d9b9bc07-b27c-4df8-ac21-b4d5be085afb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:51.054542 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d9b9bc07-b27c-4df8-ac21-b4d5be085afb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155099 Jul 21 17:48:51.055114 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 309/627] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:50 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:51.672980 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8dcb86b9-07da-4d86-8680-e202353414a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:51.673992 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8dcb86b9-07da-4d86-8680-e202353414a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:51.680484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8dcb86b9-07da-4d86-8680-e202353414a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:51.680937 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8dcb86b9-07da-4d86-8680-e202353414a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:51.681719 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8dcb86b9-07da-4d86-8680-e202353414a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:51.682175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8dcb86b9-07da-4d86-8680-e202353414a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:51.711915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8dcb86b9-07da-4d86-8680-e202353414a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042837 Jul 21 17:48:51.712730 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 319/628] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:52.071737 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3f235ea6-e4ca-4448-a01b-c8c0a0de682b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:52.072405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3f235ea6-e4ca-4448-a01b-c8c0a0de682b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:52.078829 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f235ea6-e4ca-4448-a01b-c8c0a0de682b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:52.079284 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f235ea6-e4ca-4448-a01b-c8c0a0de682b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:52.080209 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f235ea6-e4ca-4448-a01b-c8c0a0de682b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:52.080710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f235ea6-e4ca-4448-a01b-c8c0a0de682b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:52.210311 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3f235ea6-e4ca-4448-a01b-c8c0a0de682b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:52.218195 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3f235ea6-e4ca-4448-a01b-c8c0a0de682b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150331 Jul 21 17:48:52.218752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 310/629] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:52 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:52.723573 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3f75c098-619f-4144-a125-5d060b3d4683 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:52.724599 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3f75c098-619f-4144-a125-5d060b3d4683 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:52.731156 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f75c098-619f-4144-a125-5d060b3d4683 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:52.731617 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f75c098-619f-4144-a125-5d060b3d4683 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:52.732434 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f75c098-619f-4144-a125-5d060b3d4683 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:52.732880 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f75c098-619f-4144-a125-5d060b3d4683 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:52.763496 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3f75c098-619f-4144-a125-5d060b3d4683 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Jul 21 17:48:52.764045 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 320/630] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:52 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:53.235757 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-58cd9ef7-6327-47cc-8533-16e3132e18e9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:53.236404 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-58cd9ef7-6327-47cc-8533-16e3132e18e9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:53.242949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-58cd9ef7-6327-47cc-8533-16e3132e18e9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:53.243401 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-58cd9ef7-6327-47cc-8533-16e3132e18e9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:53.244173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-58cd9ef7-6327-47cc-8533-16e3132e18e9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:53.244645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-58cd9ef7-6327-47cc-8533-16e3132e18e9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:53.596104 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-58cd9ef7-6327-47cc-8533-16e3132e18e9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:53.604047 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-58cd9ef7-6327-47cc-8533-16e3132e18e9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.372118 Jul 21 17:48:53.604651 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 311/631] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:53 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:53.774854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c9842bbf-07a6-4468-909e-8e7f9306dbd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:53.775784 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c9842bbf-07a6-4468-909e-8e7f9306dbd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:53.782118 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c9842bbf-07a6-4468-909e-8e7f9306dbd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:53.782578 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c9842bbf-07a6-4468-909e-8e7f9306dbd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:53.785134 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c9842bbf-07a6-4468-909e-8e7f9306dbd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:53.785583 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c9842bbf-07a6-4468-909e-8e7f9306dbd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:53.818238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c9842bbf-07a6-4468-909e-8e7f9306dbd2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047196 Jul 21 17:48:53.819037 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 321/632] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:53 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:53.827870 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-91176631-a2d0-46a3-b712-dbd2c6afba23 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:53.828397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-91176631-a2d0-46a3-b712-dbd2c6afba23 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:53.834977 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91176631-a2d0-46a3-b712-dbd2c6afba23 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:53.835487 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91176631-a2d0-46a3-b712-dbd2c6afba23 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:53.836192 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91176631-a2d0-46a3-b712-dbd2c6afba23 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:53.836655 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91176631-a2d0-46a3-b712-dbd2c6afba23 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:53.862991 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-91176631-a2d0-46a3-b712-dbd2c6afba23 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 17:48:53.911983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:48:53.939717 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-91176631-a2d0-46a3-b712-dbd2c6afba23 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 204 len: 0 microversion: 2.1 time: 0.115213 Jul 21 17:48:53.940316 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 312/633] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 17:48:53 2022] DELETE /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 17:48:53.949252 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2a1f1b46-fc94-4a06-861d-4c7c97f20948 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:53.949985 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2a1f1b46-fc94-4a06-861d-4c7c97f20948 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:53.956965 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2a1f1b46-fc94-4a06-861d-4c7c97f20948 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:53.957449 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2a1f1b46-fc94-4a06-861d-4c7c97f20948 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:53.958266 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2a1f1b46-fc94-4a06-861d-4c7c97f20948 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:53.958777 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2a1f1b46-fc94-4a06-861d-4c7c97f20948 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:54.086087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2a1f1b46-fc94-4a06-861d-4c7c97f20948 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:54.093460 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2a1f1b46-fc94-4a06-861d-4c7c97f20948 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1679 microversion: 2.1 time: 0.148490 Jul 21 17:48:54.094471 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 322/634] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:53 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:54.622188 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1bc0b453-f185-43f9-8ff5-25efb9f75003 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:54.623048 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1bc0b453-f185-43f9-8ff5-25efb9f75003 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:54.629827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1bc0b453-f185-43f9-8ff5-25efb9f75003 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:54.630283 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1bc0b453-f185-43f9-8ff5-25efb9f75003 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:54.631061 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1bc0b453-f185-43f9-8ff5-25efb9f75003 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:54.631504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1bc0b453-f185-43f9-8ff5-25efb9f75003 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:54.830011 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-afedac79-f3e0-4555-93f9-6295da65846c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:54.830972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-afedac79-f3e0-4555-93f9-6295da65846c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:54.837559 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-afedac79-f3e0-4555-93f9-6295da65846c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:54.837766 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1bc0b453-f185-43f9-8ff5-25efb9f75003 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:54.838015 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-afedac79-f3e0-4555-93f9-6295da65846c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:54.839019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-afedac79-f3e0-4555-93f9-6295da65846c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:54.839462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-afedac79-f3e0-4555-93f9-6295da65846c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:54.846740 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1bc0b453-f185-43f9-8ff5-25efb9f75003 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.228719 Jul 21 17:48:54.847607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 313/635] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:54 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:54.872036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-afedac79-f3e0-4555-93f9-6295da65846c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046109 Jul 21 17:48:54.872761 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 323/636] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:54 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:48:55.111873 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1625c0ce-baa3-4cd3-a67c-084dc9775f5d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:55.112533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1625c0ce-baa3-4cd3-a67c-084dc9775f5d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:55.118803 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1625c0ce-baa3-4cd3-a67c-084dc9775f5d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:55.119358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1625c0ce-baa3-4cd3-a67c-084dc9775f5d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:55.120212 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1625c0ce-baa3-4cd3-a67c-084dc9775f5d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:55.120653 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1625c0ce-baa3-4cd3-a67c-084dc9775f5d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:55.201544 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1625c0ce-baa3-4cd3-a67c-084dc9775f5d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:55.209854 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1625c0ce-baa3-4cd3-a67c-084dc9775f5d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 200 len: 1612 microversion: 2.1 time: 0.102714 Jul 21 17:48:55.210429 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 314/637] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:55 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 1612 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:55.493522 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-2d723659-862e-4989-8d5f-47f90a368fc7 req-40f2eb6d-e85f-48f7-a455-a72fb373adb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7", "name": "network-vif-deleted", "tag": "dc97e3c9-88da-4cd5-883f-01b8f4999c6d"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:48:55.502809 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-2d723659-862e-4989-8d5f-47f90a368fc7 req-40f2eb6d-e85f-48f7-a455-a72fb373adb6 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:55.503515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-2d723659-862e-4989-8d5f-47f90a368fc7 req-40f2eb6d-e85f-48f7-a455-a72fb373adb6 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:55.521525 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-2d723659-862e-4989-8d5f-47f90a368fc7 req-40f2eb6d-e85f-48f7-a455-a72fb373adb6 service nova] Creating event network-vif-deleted:dc97e3c9-88da-4cd5-883f-01b8f4999c6d for instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 on hv-cinder-82549 Jul 21 17:48:55.526058 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR oslo.messaging._drivers.impl_rabbit [req-2d723659-862e-4989-8d5f-47f90a368fc7 req-40f2eb6d-e85f-48f7-a455-a72fb373adb6 service nova] [16edfd3d-351b-425a-bd7f-767bb633dc28] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 17:48:55.865198 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ca405945-f3b2-417f-8090-48bb7aa4f496 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:55.865860 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ca405945-f3b2-417f-8090-48bb7aa4f496 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:55.872110 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ca405945-f3b2-417f-8090-48bb7aa4f496 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:55.872585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ca405945-f3b2-417f-8090-48bb7aa4f496 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:55.873361 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ca405945-f3b2-417f-8090-48bb7aa4f496 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:55.874152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ca405945-f3b2-417f-8090-48bb7aa4f496 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:56.030920 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ca405945-f3b2-417f-8090-48bb7aa4f496 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:56.039964 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ca405945-f3b2-417f-8090-48bb7aa4f496 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.179997 Jul 21 17:48:56.040611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 315/638] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:55 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:48:56.045702 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d4812bf0-fd61-4756-a5cc-970823338e2b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:56.046985 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d4812bf0-fd61-4756-a5cc-970823338e2b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:56.053871 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d4812bf0-fd61-4756-a5cc-970823338e2b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:56.054328 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d4812bf0-fd61-4756-a5cc-970823338e2b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:56.055104 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d4812bf0-fd61-4756-a5cc-970823338e2b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:56.055545 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d4812bf0-fd61-4756-a5cc-970823338e2b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:56.085167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d4812bf0-fd61-4756-a5cc-970823338e2b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043359 Jul 21 17:48:56.085724 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 316/639] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:56 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:56.226703 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a9ab2d21-6d1e-47b3-9b8a-8063f0ff3aba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:56.227556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a9ab2d21-6d1e-47b3-9b8a-8063f0ff3aba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:56.234019 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9ab2d21-6d1e-47b3-9b8a-8063f0ff3aba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:56.234469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9ab2d21-6d1e-47b3-9b8a-8063f0ff3aba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:56.235287 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9ab2d21-6d1e-47b3-9b8a-8063f0ff3aba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:56.235679 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9ab2d21-6d1e-47b3-9b8a-8063f0ff3aba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:56.254496 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-a9ab2d21-6d1e-47b3-9b8a-8063f0ff3aba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] HTTP exception thrown: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a9ab2d21-6d1e-47b3-9b8a-8063f0ff3aba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Request method failure captured: Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 HTTP/1.1 Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y4MLMBby9pVb6fwZuBjDRRu9HKRFu1ubjEDLV-WnX1WKQKVX_XMZ4Yqw6FkUH0RRqITWcDICF4pmsesAnL59Rfd9lRL-u5FtRZh9LwiE1kZl5RReoX0EElUgVwXfWiOqjbNCaVPpfluVfKkWpY7Bs2i6epWgLEEnsNP5LGqfJDuT0g Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 17:48:56.256438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 17:48:56.257957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0917b2a75df4a9ab1d2cbd4fd3f7613", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}] Jul 21 17:48:56.257957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 17:48:56.257957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 17:48:56.257957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 17:48:56.257957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 17:48:56.257957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 17:48:56.257957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 17:48:56.257957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: fa82bddf9aa0455797d42993fe850ccf Jul 21 17:48:56.257957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 17:48:56.257957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 17:48:56.257957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 17:48:56.257957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7'} Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:48:56.258926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 17:48:56.260374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:48:56.261961 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a9ab2d21-6d1e-47b3-9b8a-8063f0ff3aba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Returning 404 to user: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:48:56.261961 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a9ab2d21-6d1e-47b3-9b8a-8063f0ff3aba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 404 len: 111 microversion: 2.1 time: 0.034984 Jul 21 17:48:56.261961 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 317/640] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:56 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 17:48:56.266367 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bf592f4e-44f3-4956-b8a5-fd9606454b2a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '.version_select at 0x7ffa2a56aee0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:56.269590 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bf592f4e-44f3-4956-b8a5-fd9606454b2a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [1e0608d0-2264-45ff-938e-16a2f9eb5f23] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 17:48:56.534776 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [req-2d723659-862e-4989-8d5f-47f90a368fc7 req-40f2eb6d-e85f-48f7-a455-a72fb373adb6 service nova] [16edfd3d-351b-425a-bd7f-767bb633dc28] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 37632. Jul 21 17:48:56.539219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-2d723659-862e-4989-8d5f-47f90a368fc7 req-40f2eb6d-e85f-48f7-a455-a72fb373adb6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.123255 Jul 21 17:48:56.539999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 324/641] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:57.058462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-83be4689-3f53-46a1-b06a-54a819fda745 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:57.059158 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-83be4689-3f53-46a1-b06a-54a819fda745 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:57.066333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-83be4689-3f53-46a1-b06a-54a819fda745 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:57.066783 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-83be4689-3f53-46a1-b06a-54a819fda745 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:57.067538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-83be4689-3f53-46a1-b06a-54a819fda745 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:57.067973 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-83be4689-3f53-46a1-b06a-54a819fda745 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:57.196721 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-83be4689-3f53-46a1-b06a-54a819fda745 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:57.204913 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-83be4689-3f53-46a1-b06a-54a819fda745 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150745 Jul 21 17:48:57.205630 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 325/642] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:57 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:48:57.210614 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4cc522a3-afb5-487e-a90f-1b176b40fa9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:57.211526 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4cc522a3-afb5-487e-a90f-1b176b40fa9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:57.217155 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4cc522a3-afb5-487e-a90f-1b176b40fa9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:57.217607 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4cc522a3-afb5-487e-a90f-1b176b40fa9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:57.218369 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4cc522a3-afb5-487e-a90f-1b176b40fa9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:57.218808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4cc522a3-afb5-487e-a90f-1b176b40fa9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:57.248616 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4cc522a3-afb5-487e-a90f-1b176b40fa9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041933 Jul 21 17:48:57.249178 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 326/643] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:57 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:57.277739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [None req-bf592f4e-44f3-4956-b8a5-fd9606454b2a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [1e0608d0-2264-45ff-938e-16a2f9eb5f23] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 37642. Jul 21 17:48:57.297706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bf592f4e-44f3-4956-b8a5-fd9606454b2a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272564138" status: 202 len: 0 microversion: 2.1 time: 1.034923 Jul 21 17:48:57.298340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 318/644] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jul 21 17:48:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272564138 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 17:48:57.965607 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-719f8faa-991d-44c4-8da5-4f04d35ad583 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Action: 'create', calling method: .version_select at 0x7ffa2a553940>, body: {"keypair": {"name": "tempest-keypair-383806190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpzh5zyekmiVSHpKkofA6uIeyANcz0ehwDtliAWBWjOGQOc1vNEuozCUH5MoP0+oC5CzJHld5f9C26nhl5PW343/o5DW+5zYQMM1GcfL9YbfKrYq9VU1c7HQ06dE6kNxQ=="}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:48:57.980285 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-719f8faa-991d-44c4-8da5-4f04d35ad583 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Getting quotas for project b0917b2a75df4a9ab1d2cbd4fd3f7613. Resources: {'key_pairs'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:48:57.984071 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-719f8faa-991d-44c4-8da5-4f04d35ad583 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Getting quotas for user fa82bddf9aa0455797d42993fe850ccf and project b0917b2a75df4a9ab1d2cbd4fd3f7613. Resources: {'key_pairs'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:48:57.996710 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR oslo.messaging._drivers.impl_rabbit [None req-719f8faa-991d-44c4-8da5-4f04d35ad583 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [bcc8e8c8-9ad7-4317-8ebe-fd5292fedae5] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 17:48:58.223294 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-da6f9877-c654-492d-abfc-9e93f350d66d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:58.223917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-da6f9877-c654-492d-abfc-9e93f350d66d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:58.231161 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da6f9877-c654-492d-abfc-9e93f350d66d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:58.231615 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da6f9877-c654-492d-abfc-9e93f350d66d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:58.232422 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da6f9877-c654-492d-abfc-9e93f350d66d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:58.232864 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da6f9877-c654-492d-abfc-9e93f350d66d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:58.361729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-da6f9877-c654-492d-abfc-9e93f350d66d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:58.369642 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-da6f9877-c654-492d-abfc-9e93f350d66d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150899 Jul 21 17:48:58.370197 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 319/645] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:58 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:48:58.374610 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5a6d2c80-d9d5-4548-b159-ad685e5bd486 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:58.375514 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5a6d2c80-d9d5-4548-b159-ad685e5bd486 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:58.381119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a6d2c80-d9d5-4548-b159-ad685e5bd486 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:58.381566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a6d2c80-d9d5-4548-b159-ad685e5bd486 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:58.382324 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a6d2c80-d9d5-4548-b159-ad685e5bd486 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:58.382758 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a6d2c80-d9d5-4548-b159-ad685e5bd486 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:58.414473 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5a6d2c80-d9d5-4548-b159-ad685e5bd486 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 Jul 21 17:48:58.415033 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 320/646] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:58 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:48:59.003564 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [None req-719f8faa-991d-44c4-8da5-4f04d35ad583 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [bcc8e8c8-9ad7-4317-8ebe-fd5292fedae5] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 37662. Jul 21 17:48:59.019079 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-719f8faa-991d-44c4-8da5-4f04d35ad583 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.057240 Jul 21 17:48:59.019681 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 327/647] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 17:48:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:48:59.387474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6e58c9bc-e196-4735-923c-55e706627e4e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:59.388154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6e58c9bc-e196-4735-923c-55e706627e4e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:59.396167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e58c9bc-e196-4735-923c-55e706627e4e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:59.396654 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e58c9bc-e196-4735-923c-55e706627e4e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:59.397487 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e58c9bc-e196-4735-923c-55e706627e4e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:59.397959 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6e58c9bc-e196-4735-923c-55e706627e4e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:59.427044 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-31a6dfec-6322-421a-a4de-dff420ff26cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:48:59.428068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-31a6dfec-6322-421a-a4de-dff420ff26cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:48:59.436216 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-31a6dfec-6322-421a-a4de-dff420ff26cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:59.436216 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-31a6dfec-6322-421a-a4de-dff420ff26cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:59.437085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-31a6dfec-6322-421a-a4de-dff420ff26cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:48:59.437601 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-31a6dfec-6322-421a-a4de-dff420ff26cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:48:59.473416 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-31a6dfec-6322-421a-a4de-dff420ff26cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051017 Jul 21 17:48:59.474524 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 328/648] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:48:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:48:59.543450 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6e58c9bc-e196-4735-923c-55e706627e4e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:48:59.551663 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6e58c9bc-e196-4735-923c-55e706627e4e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.168664 Jul 21 17:48:59.552233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 321/649] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:48:59 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:00.281629 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-321173373", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06d00d4d-9cae-405b-a67d-dc9e38e8701d"}], "security_groups": [{"name": "tempest-securitygroup--942727800"}], "key_name": "tempest-keypair-383806190", "user_data": "}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:49:00.381068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.network.neutron [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] validate_networks() for [('06d00d4d-9cae-405b-a67d-dc9e38e8701d', None, None, None, None, None)] {{(pid=124381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 17:49:00.485071 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-23c89f70-2ce1-41a1-8f07-c952136c6c6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:00.486122 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-23c89f70-2ce1-41a1-8f07-c952136c6c6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:00.493951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-23c89f70-2ce1-41a1-8f07-c952136c6c6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:00.494412 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-23c89f70-2ce1-41a1-8f07-c952136c6c6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:00.495223 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-23c89f70-2ce1-41a1-8f07-c952136c6c6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:00.495668 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-23c89f70-2ce1-41a1-8f07-c952136c6c6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:00.528278 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-23c89f70-2ce1-41a1-8f07-c952136c6c6e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Jul 21 17:49:00.528885 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 322/650] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:49:00.568999 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2decfb8b-1202-413e-82a8-466d9d7f1e16 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:00.569626 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2decfb8b-1202-413e-82a8-466d9d7f1e16 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:00.576085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2decfb8b-1202-413e-82a8-466d9d7f1e16 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:00.576587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2decfb8b-1202-413e-82a8-466d9d7f1e16 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:00.577368 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2decfb8b-1202-413e-82a8-466d9d7f1e16 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:00.577814 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2decfb8b-1202-413e-82a8-466d9d7f1e16 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:00.788151 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2decfb8b-1202-413e-82a8-466d9d7f1e16 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:00.796476 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2decfb8b-1202-413e-82a8-466d9d7f1e16 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.231553 Jul 21 17:49:00.797052 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 323/651] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:00 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:49:00.879377 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Flavor limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 17:49:00.879804 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Image limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 17:49:00.880367 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Flavor pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 17:49:00.880786 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Image pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 17:49:00.881208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 17:49:00.889918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:00.890377 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:00.891207 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:00.891651 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:00.910526 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Getting quotas for project b0917b2a75df4a9ab1d2cbd4fd3f7613. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:49:00.914520 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Getting quotas for user fa82bddf9aa0455797d42993fe850ccf and project b0917b2a75df4a9ab1d2cbd4fd3f7613. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:49:00.925709 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Going to run 1 instances... {{(pid=124381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 17:49:00.927933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 17:49:00.972640 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR oslo.messaging._drivers.impl_rabbit [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [36d1f0f5-1091-48f0-b029-1bd6d7175179] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 17:49:01.540250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ed6061cb-0539-44c6-a342-f87ada7f48fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:01.541204 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ed6061cb-0539-44c6-a342-f87ada7f48fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:01.547322 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed6061cb-0539-44c6-a342-f87ada7f48fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:01.547790 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed6061cb-0539-44c6-a342-f87ada7f48fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:01.548591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed6061cb-0539-44c6-a342-f87ada7f48fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:01.549035 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed6061cb-0539-44c6-a342-f87ada7f48fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:01.579778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ed6061cb-0539-44c6-a342-f87ada7f48fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043604 Jul 21 17:49:01.580347 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 324/652] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:01 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:49:01.813167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-becb90a9-d2eb-4009-b448-9ceb76c59d9b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:01.813706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-becb90a9-d2eb-4009-b448-9ceb76c59d9b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:01.820456 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-becb90a9-d2eb-4009-b448-9ceb76c59d9b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:01.820913 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-becb90a9-d2eb-4009-b448-9ceb76c59d9b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:01.821679 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-becb90a9-d2eb-4009-b448-9ceb76c59d9b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:01.822137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-becb90a9-d2eb-4009-b448-9ceb76c59d9b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:01.950133 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-becb90a9-d2eb-4009-b448-9ceb76c59d9b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:01.958354 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-becb90a9-d2eb-4009-b448-9ceb76c59d9b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149032 Jul 21 17:49:01.958918 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 325/653] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:01 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:49:01.979375 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [36d1f0f5-1091-48f0-b029-1bd6d7175179] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 37716. Jul 21 17:49:01.983229 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-49ece2e2-e0ad-40c3-a788-eac0e22847b5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.705943 Jul 21 17:49:01.983876 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 329/654] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 17:49:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 17:49:01.994291 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cbb8bd72-9d27-42d3-b69e-87b7f33cd3b8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:01.994910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cbb8bd72-9d27-42d3-b69e-87b7f33cd3b8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:02.046447 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cbb8bd72-9d27-42d3-b69e-87b7f33cd3b8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:02.053647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cbb8bd72-9d27-42d3-b69e-87b7f33cd3b8 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1240 microversion: 2.1 time: 0.063146 Jul 21 17:49:02.054211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 326/655] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:01 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1240 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:02.592285 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a8f468ea-2615-4b87-93a1-a52d90559578 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:02.593310 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a8f468ea-2615-4b87-93a1-a52d90559578 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:02.600632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a8f468ea-2615-4b87-93a1-a52d90559578 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:02.601091 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a8f468ea-2615-4b87-93a1-a52d90559578 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:02.601859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a8f468ea-2615-4b87-93a1-a52d90559578 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:02.602302 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a8f468ea-2615-4b87-93a1-a52d90559578 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:02.630799 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a8f468ea-2615-4b87-93a1-a52d90559578 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042546 Jul 21 17:49:02.631354 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 330/656] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:02.976024 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6bf86955-99b0-4e95-99da-900c7066e769 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:02.976666 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6bf86955-99b0-4e95-99da-900c7066e769 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:02.983902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bf86955-99b0-4e95-99da-900c7066e769 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:02.984379 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bf86955-99b0-4e95-99da-900c7066e769 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:02.985151 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bf86955-99b0-4e95-99da-900c7066e769 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:02.985589 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bf86955-99b0-4e95-99da-900c7066e769 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:03.072133 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-383a9f36-42cd-435a-a8a9-084ac22ab969 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:03.072796 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-383a9f36-42cd-435a-a8a9-084ac22ab969 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:03.137735 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-383a9f36-42cd-435a-a8a9-084ac22ab969 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:03.144992 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-383a9f36-42cd-435a-a8a9-084ac22ab969 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1240 microversion: 2.1 time: 0.077477 Jul 21 17:49:03.145558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 331/657] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:03 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:49:03.150047 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6bf86955-99b0-4e95-99da-900c7066e769 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:03.158005 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6bf86955-99b0-4e95-99da-900c7066e769 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.185813 Jul 21 17:49:03.158582 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 327/658] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:02 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:03.642078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5d364a61-5c52-4f10-b782-43fff1cf65e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:03.643056 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5d364a61-5c52-4f10-b782-43fff1cf65e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:03.649630 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5d364a61-5c52-4f10-b782-43fff1cf65e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:03.650075 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5d364a61-5c52-4f10-b782-43fff1cf65e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:03.650831 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5d364a61-5c52-4f10-b782-43fff1cf65e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:03.651264 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5d364a61-5c52-4f10-b782-43fff1cf65e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:03.664380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=100 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:03.680279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5d364a61-5c52-4f10-b782-43fff1cf65e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042123 Jul 21 17:49:03.680849 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 332/659] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:03 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:04.162673 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-20f4bf26-625c-4c6b-a3d4-b526f4fef29c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:04.163501 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-20f4bf26-625c-4c6b-a3d4-b526f4fef29c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:04.166012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:04.177448 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-afc4397b-1d3d-4699-9b67-ecbb5b565587 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:04.178987 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-afc4397b-1d3d-4699-9b67-ecbb5b565587 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:04.187550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-afc4397b-1d3d-4699-9b67-ecbb5b565587 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:04.187927 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-afc4397b-1d3d-4699-9b67-ecbb5b565587 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:04.188990 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-afc4397b-1d3d-4699-9b67-ecbb5b565587 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:04.189601 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-afc4397b-1d3d-4699-9b67-ecbb5b565587 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:04.223092 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-20f4bf26-625c-4c6b-a3d4-b526f4fef29c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:04.229898 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-20f4bf26-625c-4c6b-a3d4-b526f4fef29c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1240 microversion: 2.1 time: 0.072060 Jul 21 17:49:04.230458 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 328/660] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:04 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:04.329390 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-afc4397b-1d3d-4699-9b67-ecbb5b565587 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:04.338046 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-afc4397b-1d3d-4699-9b67-ecbb5b565587 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.166892 Jul 21 17:49:04.338608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 333/661] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:04 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:49:04.691813 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e82ccb95-9df8-4ed6-b3b8-ae1fc016708a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:04.692756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e82ccb95-9df8-4ed6-b3b8-ae1fc016708a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:04.698711 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e82ccb95-9df8-4ed6-b3b8-ae1fc016708a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:04.699103 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e82ccb95-9df8-4ed6-b3b8-ae1fc016708a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:04.699859 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e82ccb95-9df8-4ed6-b3b8-ae1fc016708a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:04.700311 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e82ccb95-9df8-4ed6-b3b8-ae1fc016708a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:04.730667 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e82ccb95-9df8-4ed6-b3b8-ae1fc016708a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042952 Jul 21 17:49:04.731211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 329/662] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:04 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:05.248791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8a74b4c4-0fad-4ef4-9d54-b4a80175c672 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:05.249407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8a74b4c4-0fad-4ef4-9d54-b4a80175c672 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:05.251685 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:05.316349 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8a74b4c4-0fad-4ef4-9d54-b4a80175c672 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:05.323031 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8a74b4c4-0fad-4ef4-9d54-b4a80175c672 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1240 microversion: 2.1 time: 0.078138 Jul 21 17:49:05.323684 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 334/663] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:05 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:05.355822 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-aa8fe74e-b71c-4772-bc07-4714a5ef53d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:05.356602 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-aa8fe74e-b71c-4772-bc07-4714a5ef53d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:05.363211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa8fe74e-b71c-4772-bc07-4714a5ef53d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:05.363747 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa8fe74e-b71c-4772-bc07-4714a5ef53d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:05.364558 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa8fe74e-b71c-4772-bc07-4714a5ef53d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:05.365616 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa8fe74e-b71c-4772-bc07-4714a5ef53d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:05.500868 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-aa8fe74e-b71c-4772-bc07-4714a5ef53d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:05.509474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-aa8fe74e-b71c-4772-bc07-4714a5ef53d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.157579 Jul 21 17:49:05.510463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 330/664] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:05 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:05.742875 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8a4b207a-80de-4463-a45a-38471510b071 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:05.743801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8a4b207a-80de-4463-a45a-38471510b071 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:05.750429 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8a4b207a-80de-4463-a45a-38471510b071 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:05.750809 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8a4b207a-80de-4463-a45a-38471510b071 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:05.751574 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8a4b207a-80de-4463-a45a-38471510b071 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:05.752012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8a4b207a-80de-4463-a45a-38471510b071 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:05.780619 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8a4b207a-80de-4463-a45a-38471510b071 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041650 Jul 21 17:49:05.781170 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 335/665] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:06.390900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5df91fc9-e26c-4382-9174-74d6e44775ba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:06.391624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5df91fc9-e26c-4382-9174-74d6e44775ba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:06.398556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5df91fc9-e26c-4382-9174-74d6e44775ba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:06.398999 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5df91fc9-e26c-4382-9174-74d6e44775ba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:06.399761 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5df91fc9-e26c-4382-9174-74d6e44775ba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:06.400194 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5df91fc9-e26c-4382-9174-74d6e44775ba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:06.465783 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5df91fc9-e26c-4382-9174-74d6e44775ba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:06.473953 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5df91fc9-e26c-4382-9174-74d6e44775ba tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1244 microversion: 2.1 time: 0.137480 Jul 21 17:49:06.474516 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 331/666] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:06 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1244 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:06.527780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-39d8d1db-a1e7-412c-999c-4c671528e8ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:06.528427 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-39d8d1db-a1e7-412c-999c-4c671528e8ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:06.536670 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-39d8d1db-a1e7-412c-999c-4c671528e8ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:06.537128 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-39d8d1db-a1e7-412c-999c-4c671528e8ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:06.537908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-39d8d1db-a1e7-412c-999c-4c671528e8ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:06.538347 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-39d8d1db-a1e7-412c-999c-4c671528e8ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:06.673374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-39d8d1db-a1e7-412c-999c-4c671528e8ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:06.682424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-39d8d1db-a1e7-412c-999c-4c671528e8ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.158753 Jul 21 17:49:06.683367 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 336/667] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:06 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:06.791404 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-82ce6ca9-d9db-4d68-866a-9ffc40f30bea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:06.792413 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-82ce6ca9-d9db-4d68-866a-9ffc40f30bea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:06.798457 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82ce6ca9-d9db-4d68-866a-9ffc40f30bea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:06.798910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82ce6ca9-d9db-4d68-866a-9ffc40f30bea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:06.800367 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82ce6ca9-d9db-4d68-866a-9ffc40f30bea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:06.800802 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82ce6ca9-d9db-4d68-866a-9ffc40f30bea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:06.828636 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-82ce6ca9-d9db-4d68-866a-9ffc40f30bea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041063 Jul 21 17:49:06.829110 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 332/668] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:06 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:49:07.489777 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3ec55680-fd7f-48eb-bc9e-e9eeffbb097e tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:07.490497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3ec55680-fd7f-48eb-bc9e-e9eeffbb097e tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:07.496706 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3ec55680-fd7f-48eb-bc9e-e9eeffbb097e tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:07.497068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3ec55680-fd7f-48eb-bc9e-e9eeffbb097e tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:07.497959 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3ec55680-fd7f-48eb-bc9e-e9eeffbb097e tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:07.498469 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3ec55680-fd7f-48eb-bc9e-e9eeffbb097e tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:07.576043 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3ec55680-fd7f-48eb-bc9e-e9eeffbb097e tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:07.588193 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3ec55680-fd7f-48eb-bc9e-e9eeffbb097e tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1298 microversion: 2.1 time: 0.100849 Jul 21 17:49:07.596746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 337/669] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:07 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:07.699257 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-188ad07a-3ad9-4673-acb3-ae2211570099 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:07.699973 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-188ad07a-3ad9-4673-acb3-ae2211570099 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:07.707173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-188ad07a-3ad9-4673-acb3-ae2211570099 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:07.707628 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-188ad07a-3ad9-4673-acb3-ae2211570099 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:07.708504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-188ad07a-3ad9-4673-acb3-ae2211570099 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:07.708946 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-188ad07a-3ad9-4673-acb3-ae2211570099 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:07.711500 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:07.840210 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-74a2a3f2-10c7-4069-aed7-a18a313027cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:07.841218 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-74a2a3f2-10c7-4069-aed7-a18a313027cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:07.848596 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-74a2a3f2-10c7-4069-aed7-a18a313027cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:07.849065 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-74a2a3f2-10c7-4069-aed7-a18a313027cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:07.849851 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-74a2a3f2-10c7-4069-aed7-a18a313027cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:07.850293 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-74a2a3f2-10c7-4069-aed7-a18a313027cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:07.885036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-188ad07a-3ad9-4673-acb3-ae2211570099 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:07.892104 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-74a2a3f2-10c7-4069-aed7-a18a313027cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055763 Jul 21 17:49:07.893503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 338/670] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:07 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:49:07.901511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-188ad07a-3ad9-4673-acb3-ae2211570099 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.206053 Jul 21 17:49:07.902187 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 333/671] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:07 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:08.562387 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-af311427-3ce7-4866-a157-6c469e7cb61d req-24277b1d-ac7f-46ac-b984-89a3ab6c2c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2e5488-2d1e-4068-879f-7ceba9b9f06c", "tag": "c146c9f3-9d7c-4fc3-8dd4-0187175d73bb"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:49:08.571533 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-af311427-3ce7-4866-a157-6c469e7cb61d req-24277b1d-ac7f-46ac-b984-89a3ab6c2c62 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:08.571999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-af311427-3ce7-4866-a157-6c469e7cb61d req-24277b1d-ac7f-46ac-b984-89a3ab6c2c62 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:08.583975 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-af311427-3ce7-4866-a157-6c469e7cb61d req-24277b1d-ac7f-46ac-b984-89a3ab6c2c62 service nova] Creating event network-changed:c146c9f3-9d7c-4fc3-8dd4-0187175d73bb for instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c on hv-cinder-82549 Jul 21 17:49:08.589107 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-af311427-3ce7-4866-a157-6c469e7cb61d req-24277b1d-ac7f-46ac-b984-89a3ab6c2c62 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030354 Jul 21 17:49:08.589715 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 339/672] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:08.606333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4d5d160e-7ec8-4cf7-9e27-28824b7b227c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:08.607075 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4d5d160e-7ec8-4cf7-9e27-28824b7b227c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:08.613772 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d5d160e-7ec8-4cf7-9e27-28824b7b227c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:08.614385 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d5d160e-7ec8-4cf7-9e27-28824b7b227c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:08.615863 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d5d160e-7ec8-4cf7-9e27-28824b7b227c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:08.616449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d5d160e-7ec8-4cf7-9e27-28824b7b227c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:08.855230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4d5d160e-7ec8-4cf7-9e27-28824b7b227c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:08.862853 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4d5d160e-7ec8-4cf7-9e27-28824b7b227c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1365 microversion: 2.1 time: 0.260659 Jul 21 17:49:08.863415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 334/673] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:08 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:08.905714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-578a717f-bcf3-4831-a3d0-de6ca2c03db3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:08.906999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-578a717f-bcf3-4831-a3d0-de6ca2c03db3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:08.914472 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-578a717f-bcf3-4831-a3d0-de6ca2c03db3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:08.915209 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-578a717f-bcf3-4831-a3d0-de6ca2c03db3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:08.916066 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-578a717f-bcf3-4831-a3d0-de6ca2c03db3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:08.916613 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-578a717f-bcf3-4831-a3d0-de6ca2c03db3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:08.920369 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3e69c202-7da7-4dc6-b5e4-4cf1d3cef3b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:08.921196 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3e69c202-7da7-4dc6-b5e4-4cf1d3cef3b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:08.927684 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e69c202-7da7-4dc6-b5e4-4cf1d3cef3b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:08.928131 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e69c202-7da7-4dc6-b5e4-4cf1d3cef3b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:08.933139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e69c202-7da7-4dc6-b5e4-4cf1d3cef3b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:08.933139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e69c202-7da7-4dc6-b5e4-4cf1d3cef3b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:08.950833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-578a717f-bcf3-4831-a3d0-de6ca2c03db3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049464 Jul 21 17:49:08.951887 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 340/674] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:09.145552 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3e69c202-7da7-4dc6-b5e4-4cf1d3cef3b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:09.153480 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3e69c202-7da7-4dc6-b5e4-4cf1d3cef3b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.236995 Jul 21 17:49:09.154040 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 335/675] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:08 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:09.878808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0122bf78-ff81-49e4-9f47-1c9a5bff007f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:09.879422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0122bf78-ff81-49e4-9f47-1c9a5bff007f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:09.891511 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0122bf78-ff81-49e4-9f47-1c9a5bff007f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:09.891964 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0122bf78-ff81-49e4-9f47-1c9a5bff007f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:09.892920 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0122bf78-ff81-49e4-9f47-1c9a5bff007f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:09.893382 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0122bf78-ff81-49e4-9f47-1c9a5bff007f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:09.963340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eaa2ce24-211d-4283-a10b-469205251763 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:09.964955 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eaa2ce24-211d-4283-a10b-469205251763 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:09.973518 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eaa2ce24-211d-4283-a10b-469205251763 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:09.974093 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eaa2ce24-211d-4283-a10b-469205251763 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:09.975326 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eaa2ce24-211d-4283-a10b-469205251763 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:09.975996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eaa2ce24-211d-4283-a10b-469205251763 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:10.013358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eaa2ce24-211d-4283-a10b-469205251763 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054936 Jul 21 17:49:10.014467 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 336/676] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:49:10.115044 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0122bf78-ff81-49e4-9f47-1c9a5bff007f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:10.124942 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0122bf78-ff81-49e4-9f47-1c9a5bff007f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1365 microversion: 2.1 time: 0.249571 Jul 21 17:49:10.125553 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 341/677] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:09 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:10.171144 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0d7d9dac-3086-44e4-8afb-c6fb6d457062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:10.172022 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0d7d9dac-3086-44e4-8afb-c6fb6d457062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:10.183380 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d7d9dac-3086-44e4-8afb-c6fb6d457062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:10.183832 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d7d9dac-3086-44e4-8afb-c6fb6d457062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:10.184825 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d7d9dac-3086-44e4-8afb-c6fb6d457062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:10.185516 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d7d9dac-3086-44e4-8afb-c6fb6d457062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:10.397917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0d7d9dac-3086-44e4-8afb-c6fb6d457062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:10.406339 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0d7d9dac-3086-44e4-8afb-c6fb6d457062 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.239747 Jul 21 17:49:10.406897 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 337/678] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:10 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:11.025240 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8a804baa-9378-41ea-9e7f-9b1af107544f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:11.026160 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8a804baa-9378-41ea-9e7f-9b1af107544f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:11.028665 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:11.034176 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8a804baa-9378-41ea-9e7f-9b1af107544f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:11.034622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8a804baa-9378-41ea-9e7f-9b1af107544f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:11.035388 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8a804baa-9378-41ea-9e7f-9b1af107544f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:11.035827 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8a804baa-9378-41ea-9e7f-9b1af107544f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:11.065937 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8a804baa-9378-41ea-9e7f-9b1af107544f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043897 Jul 21 17:49:11.066489 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 342/679] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:11 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:11.141938 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0774d1ce-b885-4a1d-a002-78415376a9e0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:11.142563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0774d1ce-b885-4a1d-a002-78415376a9e0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:11.149260 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0774d1ce-b885-4a1d-a002-78415376a9e0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:11.149716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0774d1ce-b885-4a1d-a002-78415376a9e0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:11.150491 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0774d1ce-b885-4a1d-a002-78415376a9e0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:11.150935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0774d1ce-b885-4a1d-a002-78415376a9e0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:11.281609 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0774d1ce-b885-4a1d-a002-78415376a9e0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:11.291013 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0774d1ce-b885-4a1d-a002-78415376a9e0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1365 microversion: 2.1 time: 0.153151 Jul 21 17:49:11.291580 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 338/680] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:11 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:11.424583 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-75f4c452-3f8c-40ae-b87f-7914b9d62f6e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:11.425197 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-75f4c452-3f8c-40ae-b87f-7914b9d62f6e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:11.432001 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-75f4c452-3f8c-40ae-b87f-7914b9d62f6e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:11.432497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-75f4c452-3f8c-40ae-b87f-7914b9d62f6e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:11.433274 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-75f4c452-3f8c-40ae-b87f-7914b9d62f6e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:11.433716 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-75f4c452-3f8c-40ae-b87f-7914b9d62f6e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:11.785209 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-75f4c452-3f8c-40ae-b87f-7914b9d62f6e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:11.793098 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-75f4c452-3f8c-40ae-b87f-7914b9d62f6e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.372967 Jul 21 17:49:11.793670 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 343/681] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:11 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:12.077360 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2de71c9b-45f3-4af8-92ac-8b3bf06a3343 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:12.078285 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2de71c9b-45f3-4af8-92ac-8b3bf06a3343 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:12.085282 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2de71c9b-45f3-4af8-92ac-8b3bf06a3343 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:12.085736 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2de71c9b-45f3-4af8-92ac-8b3bf06a3343 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:12.086501 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2de71c9b-45f3-4af8-92ac-8b3bf06a3343 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:12.086939 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2de71c9b-45f3-4af8-92ac-8b3bf06a3343 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:12.114622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2de71c9b-45f3-4af8-92ac-8b3bf06a3343 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041201 Jul 21 17:49:12.115168 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 339/682] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:12 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:12.308538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e45f08b8-a63d-4210-a016-a2d83f1df5f0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:12.309261 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e45f08b8-a63d-4210-a016-a2d83f1df5f0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:12.316055 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e45f08b8-a63d-4210-a016-a2d83f1df5f0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:12.316600 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e45f08b8-a63d-4210-a016-a2d83f1df5f0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:12.317313 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e45f08b8-a63d-4210-a016-a2d83f1df5f0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:12.317750 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e45f08b8-a63d-4210-a016-a2d83f1df5f0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:12.449417 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e45f08b8-a63d-4210-a016-a2d83f1df5f0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:12.457489 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e45f08b8-a63d-4210-a016-a2d83f1df5f0 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1365 microversion: 2.1 time: 0.152773 Jul 21 17:49:12.458156 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 344/683] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:12 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:12.814397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4e8b8840-d26d-4967-be7c-179a91ec501f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:12.815610 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4e8b8840-d26d-4967-be7c-179a91ec501f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:12.823305 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e8b8840-d26d-4967-be7c-179a91ec501f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:12.823749 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e8b8840-d26d-4967-be7c-179a91ec501f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:12.824546 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e8b8840-d26d-4967-be7c-179a91ec501f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:12.824983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e8b8840-d26d-4967-be7c-179a91ec501f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:12.961372 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4e8b8840-d26d-4967-be7c-179a91ec501f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:12.969193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4e8b8840-d26d-4967-be7c-179a91ec501f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.162085 Jul 21 17:49:12.969756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 340/684] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:12 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:13.125323 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-67781e50-9aa0-4c93-ae08-fbdc320220b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:13.126246 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-67781e50-9aa0-4c93-ae08-fbdc320220b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:13.132397 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-67781e50-9aa0-4c93-ae08-fbdc320220b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:13.132848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-67781e50-9aa0-4c93-ae08-fbdc320220b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:13.133605 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-67781e50-9aa0-4c93-ae08-fbdc320220b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:13.134039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-67781e50-9aa0-4c93-ae08-fbdc320220b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:13.163025 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-67781e50-9aa0-4c93-ae08-fbdc320220b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041674 Jul 21 17:49:13.163557 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 345/685] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:13.474470 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-afb6be3e-ae16-4682-875f-172622df3ec6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:13.475469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-afb6be3e-ae16-4682-875f-172622df3ec6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:13.483419 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-afb6be3e-ae16-4682-875f-172622df3ec6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:13.483877 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-afb6be3e-ae16-4682-875f-172622df3ec6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:13.484685 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-afb6be3e-ae16-4682-875f-172622df3ec6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:13.485130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-afb6be3e-ae16-4682-875f-172622df3ec6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:13.620345 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-afb6be3e-ae16-4682-875f-172622df3ec6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:13.628231 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-afb6be3e-ae16-4682-875f-172622df3ec6 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1365 microversion: 2.1 time: 0.158622 Jul 21 17:49:13.628826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 341/686] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:13 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:13.986904 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-676c73e0-fac7-4109-833c-16de810bc37f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:13.987618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-676c73e0-fac7-4109-833c-16de810bc37f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:13.994113 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-676c73e0-fac7-4109-833c-16de810bc37f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:13.994556 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-676c73e0-fac7-4109-833c-16de810bc37f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:13.995317 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-676c73e0-fac7-4109-833c-16de810bc37f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:13.995751 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-676c73e0-fac7-4109-833c-16de810bc37f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:14.138021 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-676c73e0-fac7-4109-833c-16de810bc37f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:14.146444 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-676c73e0-fac7-4109-833c-16de810bc37f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.163425 Jul 21 17:49:14.147007 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 346/687] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:13 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:14.222430 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-49b799f3-b7b4-4e0e-b1ae-68eebd952f54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:14.223409 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-49b799f3-b7b4-4e0e-b1ae-68eebd952f54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:14.228496 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:14.231134 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49b799f3-b7b4-4e0e-b1ae-68eebd952f54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:14.231597 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49b799f3-b7b4-4e0e-b1ae-68eebd952f54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:14.232929 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49b799f3-b7b4-4e0e-b1ae-68eebd952f54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:14.233387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49b799f3-b7b4-4e0e-b1ae-68eebd952f54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:14.265974 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-49b799f3-b7b4-4e0e-b1ae-68eebd952f54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095343 Jul 21 17:49:14.266878 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 342/688] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:14 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:14.488813 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-771c3564-4ac2-410f-9eb3-160840be6e8a req-aa5e8c10-2735-4f52-aa99-99c9dc7d7ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2e5488-2d1e-4068-879f-7ceba9b9f06c", "name": "network-vif-plugged", "status": "completed", "tag": "c146c9f3-9d7c-4fc3-8dd4-0187175d73bb"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:49:14.497091 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-771c3564-4ac2-410f-9eb3-160840be6e8a req-aa5e8c10-2735-4f52-aa99-99c9dc7d7ae8 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:14.497540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-771c3564-4ac2-410f-9eb3-160840be6e8a req-aa5e8c10-2735-4f52-aa99-99c9dc7d7ae8 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:14.510456 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-771c3564-4ac2-410f-9eb3-160840be6e8a req-aa5e8c10-2735-4f52-aa99-99c9dc7d7ae8 service nova] Creating event network-vif-plugged:c146c9f3-9d7c-4fc3-8dd4-0187175d73bb for instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c on hv-cinder-82549 Jul 21 17:49:14.516800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-771c3564-4ac2-410f-9eb3-160840be6e8a req-aa5e8c10-2735-4f52-aa99-99c9dc7d7ae8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091902 Jul 21 17:49:14.517287 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 347/689] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:14.644885 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-42e6a680-9831-47eb-a06e-ed7223e20004 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:14.645706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-42e6a680-9831-47eb-a06e-ed7223e20004 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:14.653203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42e6a680-9831-47eb-a06e-ed7223e20004 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:14.653819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42e6a680-9831-47eb-a06e-ed7223e20004 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:14.654902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42e6a680-9831-47eb-a06e-ed7223e20004 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:14.655353 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42e6a680-9831-47eb-a06e-ed7223e20004 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:14.802987 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-42e6a680-9831-47eb-a06e-ed7223e20004 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:14.810892 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-42e6a680-9831-47eb-a06e-ed7223e20004 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1365 microversion: 2.1 time: 0.170143 Jul 21 17:49:14.812594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 343/690] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:14 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:15.164353 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-12de016f-1564-48b2-ab84-51dab0807605 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:15.165057 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-12de016f-1564-48b2-ab84-51dab0807605 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:15.171311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12de016f-1564-48b2-ab84-51dab0807605 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:15.171755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12de016f-1564-48b2-ab84-51dab0807605 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:15.172553 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12de016f-1564-48b2-ab84-51dab0807605 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:15.172990 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12de016f-1564-48b2-ab84-51dab0807605 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:15.279197 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b4ee2d55-a150-4366-90ea-801018be57d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:15.280123 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b4ee2d55-a150-4366-90ea-801018be57d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:15.287407 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4ee2d55-a150-4366-90ea-801018be57d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:15.287863 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4ee2d55-a150-4366-90ea-801018be57d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:15.288667 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4ee2d55-a150-4366-90ea-801018be57d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:15.289103 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4ee2d55-a150-4366-90ea-801018be57d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:15.311846 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-12de016f-1564-48b2-ab84-51dab0807605 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:15.319929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-12de016f-1564-48b2-ab84-51dab0807605 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.160172 Jul 21 17:49:15.320525 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 348/691] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:15 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:15.320686 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b4ee2d55-a150-4366-90ea-801018be57d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045237 Jul 21 17:49:15.321118 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 344/692] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:49:15.829829 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bc31e45a-07c6-48ab-9d57-a3b03c4e3682 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:15.830704 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bc31e45a-07c6-48ab-9d57-a3b03c4e3682 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:15.832502 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=14 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:15.838035 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc31e45a-07c6-48ab-9d57-a3b03c4e3682 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:15.838493 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc31e45a-07c6-48ab-9d57-a3b03c4e3682 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:15.839625 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc31e45a-07c6-48ab-9d57-a3b03c4e3682 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:15.839716 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc31e45a-07c6-48ab-9d57-a3b03c4e3682 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:15.974288 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-bc31e45a-07c6-48ab-9d57-a3b03c4e3682 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:15.981915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bc31e45a-07c6-48ab-9d57-a3b03c4e3682 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1365 microversion: 2.1 time: 0.155886 Jul 21 17:49:15.982501 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 349/693] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:15 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:16.330970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-99dd9ee7-06af-4f64-af53-a7768c137eb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:16.332005 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-99dd9ee7-06af-4f64-af53-a7768c137eb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:16.336424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-12ff621d-a7bf-41ca-8a0a-1b42491a45b3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:16.337111 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-12ff621d-a7bf-41ca-8a0a-1b42491a45b3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:16.338556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99dd9ee7-06af-4f64-af53-a7768c137eb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:16.339008 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99dd9ee7-06af-4f64-af53-a7768c137eb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:16.339782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99dd9ee7-06af-4f64-af53-a7768c137eb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:16.340224 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99dd9ee7-06af-4f64-af53-a7768c137eb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:16.343822 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12ff621d-a7bf-41ca-8a0a-1b42491a45b3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:16.344275 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12ff621d-a7bf-41ca-8a0a-1b42491a45b3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:16.345078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12ff621d-a7bf-41ca-8a0a-1b42491a45b3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:16.345518 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-12ff621d-a7bf-41ca-8a0a-1b42491a45b3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:16.376681 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-99dd9ee7-06af-4f64-af53-a7768c137eb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049503 Jul 21 17:49:16.378145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 345/694] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:16 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:16.478835 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-12ff621d-a7bf-41ca-8a0a-1b42491a45b3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:16.487565 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-12ff621d-a7bf-41ca-8a0a-1b42491a45b3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154062 Jul 21 17:49:16.488127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 350/695] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:16 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:16.998992 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-31d42e6c-add6-4ec1-9628-f5e148a8e210 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:16.999606 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-31d42e6c-add6-4ec1-9628-f5e148a8e210 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:17.006746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-31d42e6c-add6-4ec1-9628-f5e148a8e210 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:17.007201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-31d42e6c-add6-4ec1-9628-f5e148a8e210 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:17.007999 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-31d42e6c-add6-4ec1-9628-f5e148a8e210 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:17.008493 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-31d42e6c-add6-4ec1-9628-f5e148a8e210 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:17.139634 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-31d42e6c-add6-4ec1-9628-f5e148a8e210 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:17.147157 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-31d42e6c-add6-4ec1-9628-f5e148a8e210 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1555 microversion: 2.1 time: 0.152062 Jul 21 17:49:17.147715 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 346/696] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:16 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:17.163357 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d59d97d7-a7e9-477d-b75f-631b573fa60d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:17.163908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d59d97d7-a7e9-477d-b75f-631b573fa60d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:17.169894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d59d97d7-a7e9-477d-b75f-631b573fa60d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:17.170341 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d59d97d7-a7e9-477d-b75f-631b573fa60d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:17.171095 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d59d97d7-a7e9-477d-b75f-631b573fa60d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:17.171531 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d59d97d7-a7e9-477d-b75f-631b573fa60d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:17.185428 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=100 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:17.253087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d59d97d7-a7e9-477d-b75f-631b573fa60d tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093515 Jul 21 17:49:17.253704 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 351/697] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 17:49:17 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:17.389083 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-089dca35-5198-4215-8c31-084a69da987b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:17.390850 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-089dca35-5198-4215-8c31-084a69da987b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:17.397293 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-089dca35-5198-4215-8c31-084a69da987b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:17.397747 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-089dca35-5198-4215-8c31-084a69da987b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:17.398525 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-089dca35-5198-4215-8c31-084a69da987b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:17.398963 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-089dca35-5198-4215-8c31-084a69da987b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:17.428739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-089dca35-5198-4215-8c31-084a69da987b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043665 Jul 21 17:49:17.429308 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 347/698] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:17 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:17.505294 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-60a4fc43-ac2d-4a79-9ede-f3a679ed7114 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:17.505924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-60a4fc43-ac2d-4a79-9ede-f3a679ed7114 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:17.511998 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-60a4fc43-ac2d-4a79-9ede-f3a679ed7114 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:17.512566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-60a4fc43-ac2d-4a79-9ede-f3a679ed7114 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:17.513432 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-60a4fc43-ac2d-4a79-9ede-f3a679ed7114 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:17.513954 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-60a4fc43-ac2d-4a79-9ede-f3a679ed7114 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:17.849592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-60a4fc43-ac2d-4a79-9ede-f3a679ed7114 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:17.857580 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-60a4fc43-ac2d-4a79-9ede-f3a679ed7114 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.357489 Jul 21 17:49:17.858146 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 352/699] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:17 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:18.399390 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-7e6b2ce8-e602-460a-9e19-99c422a346b4 req-65579a70-637b-4be4-8722-71e1e2d10740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2e5488-2d1e-4068-879f-7ceba9b9f06c", "tag": "c146c9f3-9d7c-4fc3-8dd4-0187175d73bb"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:49:18.410176 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-7e6b2ce8-e602-460a-9e19-99c422a346b4 req-65579a70-637b-4be4-8722-71e1e2d10740 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:18.410905 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-7e6b2ce8-e602-460a-9e19-99c422a346b4 req-65579a70-637b-4be4-8722-71e1e2d10740 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:18.422563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-7e6b2ce8-e602-460a-9e19-99c422a346b4 req-65579a70-637b-4be4-8722-71e1e2d10740 service nova] Creating event network-changed:c146c9f3-9d7c-4fc3-8dd4-0187175d73bb for instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c on hv-cinder-82549 Jul 21 17:49:18.428348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-7e6b2ce8-e602-460a-9e19-99c422a346b4 req-65579a70-637b-4be4-8722-71e1e2d10740 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032647 Jul 21 17:49:18.429051 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 348/700] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:18.444589 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-20c5ec30-59aa-4af2-8897-bf0da647355d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:18.445784 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-20c5ec30-59aa-4af2-8897-bf0da647355d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:18.451896 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-20c5ec30-59aa-4af2-8897-bf0da647355d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:18.452376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-20c5ec30-59aa-4af2-8897-bf0da647355d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:18.453141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-20c5ec30-59aa-4af2-8897-bf0da647355d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:18.453573 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-20c5ec30-59aa-4af2-8897-bf0da647355d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:18.484915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-20c5ec30-59aa-4af2-8897-bf0da647355d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048466 Jul 21 17:49:18.485670 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 353/701] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:18 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:18.875388 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-529cb33e-3a4e-412f-b5ea-7e4a58f1bdf0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:18.876518 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-529cb33e-3a4e-412f-b5ea-7e4a58f1bdf0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:18.883180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-529cb33e-3a4e-412f-b5ea-7e4a58f1bdf0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:18.883722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-529cb33e-3a4e-412f-b5ea-7e4a58f1bdf0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:18.884826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-529cb33e-3a4e-412f-b5ea-7e4a58f1bdf0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:18.885339 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-529cb33e-3a4e-412f-b5ea-7e4a58f1bdf0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:19.036955 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-529cb33e-3a4e-412f-b5ea-7e4a58f1bdf0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:19.045137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-529cb33e-3a4e-412f-b5ea-7e4a58f1bdf0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.174182 Jul 21 17:49:19.045706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 349/702] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:18 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:19.498600 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a4ecbb90-d9d8-4000-adb6-babed7a4dfc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:19.499536 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a4ecbb90-d9d8-4000-adb6-babed7a4dfc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:19.506507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a4ecbb90-d9d8-4000-adb6-babed7a4dfc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:19.506959 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a4ecbb90-d9d8-4000-adb6-babed7a4dfc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:19.507728 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a4ecbb90-d9d8-4000-adb6-babed7a4dfc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:19.508169 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a4ecbb90-d9d8-4000-adb6-babed7a4dfc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:19.538704 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a4ecbb90-d9d8-4000-adb6-babed7a4dfc0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044114 Jul 21 17:49:19.539253 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 354/703] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:19 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:20.063259 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f9f95f3b-9a8d-42b5-a790-84db382f599c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:20.063882 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f9f95f3b-9a8d-42b5-a790-84db382f599c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:20.070875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9f95f3b-9a8d-42b5-a790-84db382f599c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:20.071339 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9f95f3b-9a8d-42b5-a790-84db382f599c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:20.072109 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9f95f3b-9a8d-42b5-a790-84db382f599c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:20.072577 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9f95f3b-9a8d-42b5-a790-84db382f599c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:20.087908 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:20.206287 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f9f95f3b-9a8d-42b5-a790-84db382f599c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:20.214317 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f9f95f3b-9a8d-42b5-a790-84db382f599c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154975 Jul 21 17:49:20.214886 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 350/704] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:20 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:20.551120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-71f34c00-dc08-4ea7-bc69-52a7478f5cc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:20.552045 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-71f34c00-dc08-4ea7-bc69-52a7478f5cc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:20.558496 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-71f34c00-dc08-4ea7-bc69-52a7478f5cc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:20.558948 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-71f34c00-dc08-4ea7-bc69-52a7478f5cc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:20.559721 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-71f34c00-dc08-4ea7-bc69-52a7478f5cc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:20.560161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-71f34c00-dc08-4ea7-bc69-52a7478f5cc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:20.589854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-71f34c00-dc08-4ea7-bc69-52a7478f5cc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Jul 21 17:49:20.590400 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 355/705] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:20 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:21.232003 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-771e9c21-d364-4750-a5e1-4243fc18d4ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:21.232564 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-771e9c21-d364-4750-a5e1-4243fc18d4ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:21.239012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-771e9c21-d364-4750-a5e1-4243fc18d4ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:21.239468 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-771e9c21-d364-4750-a5e1-4243fc18d4ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:21.240237 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-771e9c21-d364-4750-a5e1-4243fc18d4ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:21.240704 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-771e9c21-d364-4750-a5e1-4243fc18d4ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:21.369063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-771e9c21-d364-4750-a5e1-4243fc18d4ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:21.378172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-771e9c21-d364-4750-a5e1-4243fc18d4ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150115 Jul 21 17:49:21.378743 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 351/706] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:21 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:21.601017 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f94c0db1-71ae-4fd4-9a76-9ab1ec8b9e4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:21.601950 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f94c0db1-71ae-4fd4-9a76-9ab1ec8b9e4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:21.608450 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f94c0db1-71ae-4fd4-9a76-9ab1ec8b9e4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:21.608905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f94c0db1-71ae-4fd4-9a76-9ab1ec8b9e4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:21.609667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f94c0db1-71ae-4fd4-9a76-9ab1ec8b9e4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:21.610123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f94c0db1-71ae-4fd4-9a76-9ab1ec8b9e4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:21.639423 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f94c0db1-71ae-4fd4-9a76-9ab1ec8b9e4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042338 Jul 21 17:49:21.639974 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 356/707] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:49:22.395301 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f83817c0-8cde-4359-845e-a65c81108d3a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:22.395907 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f83817c0-8cde-4359-845e-a65c81108d3a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:22.402342 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f83817c0-8cde-4359-845e-a65c81108d3a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:22.403211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f83817c0-8cde-4359-845e-a65c81108d3a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:22.403536 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f83817c0-8cde-4359-845e-a65c81108d3a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:22.403971 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f83817c0-8cde-4359-845e-a65c81108d3a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:22.531442 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f83817c0-8cde-4359-845e-a65c81108d3a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:22.539678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f83817c0-8cde-4359-845e-a65c81108d3a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148705 Jul 21 17:49:22.540236 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 352/708] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:22 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:22.650548 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4d9cc125-c924-42a1-8ddc-5089098e3868 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:22.651499 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4d9cc125-c924-42a1-8ddc-5089098e3868 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:22.657913 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4d9cc125-c924-42a1-8ddc-5089098e3868 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:22.658404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4d9cc125-c924-42a1-8ddc-5089098e3868 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:22.659173 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4d9cc125-c924-42a1-8ddc-5089098e3868 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:22.659613 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4d9cc125-c924-42a1-8ddc-5089098e3868 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:22.687529 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4d9cc125-c924-42a1-8ddc-5089098e3868 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040926 Jul 21 17:49:22.688064 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 357/709] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:22 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:23.556514 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-efddbfa5-a93a-4bd1-a9f8-7b69db563c0d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:23.557128 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-efddbfa5-a93a-4bd1-a9f8-7b69db563c0d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:23.563656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efddbfa5-a93a-4bd1-a9f8-7b69db563c0d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:23.564105 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efddbfa5-a93a-4bd1-a9f8-7b69db563c0d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:23.565417 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efddbfa5-a93a-4bd1-a9f8-7b69db563c0d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:23.566115 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efddbfa5-a93a-4bd1-a9f8-7b69db563c0d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:23.699114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7b5da4f1-5359-484f-9960-e252e6e785e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:23.700036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7b5da4f1-5359-484f-9960-e252e6e785e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:23.702951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-efddbfa5-a93a-4bd1-a9f8-7b69db563c0d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:23.707314 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7b5da4f1-5359-484f-9960-e252e6e785e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:23.707762 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7b5da4f1-5359-484f-9960-e252e6e785e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:23.708553 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7b5da4f1-5359-484f-9960-e252e6e785e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:23.708994 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7b5da4f1-5359-484f-9960-e252e6e785e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:23.711643 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-efddbfa5-a93a-4bd1-a9f8-7b69db563c0d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.158995 Jul 21 17:49:23.712415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 353/710] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:23 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:23.738077 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7b5da4f1-5359-484f-9960-e252e6e785e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 Jul 21 17:49:23.738618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 358/711] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:23 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:24.729014 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e128aa46-8ce6-4cd8-9f04-f2e91b5e2e10 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:24.729626 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e128aa46-8ce6-4cd8-9f04-f2e91b5e2e10 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:24.736071 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e128aa46-8ce6-4cd8-9f04-f2e91b5e2e10 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:24.736556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e128aa46-8ce6-4cd8-9f04-f2e91b5e2e10 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:24.737317 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e128aa46-8ce6-4cd8-9f04-f2e91b5e2e10 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:24.737750 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e128aa46-8ce6-4cd8-9f04-f2e91b5e2e10 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:24.749479 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-52bd0e8b-4a8c-47eb-88e5-5aa2be035d1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:24.750406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-52bd0e8b-4a8c-47eb-88e5-5aa2be035d1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:24.757705 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52bd0e8b-4a8c-47eb-88e5-5aa2be035d1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:24.758160 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52bd0e8b-4a8c-47eb-88e5-5aa2be035d1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:24.758958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52bd0e8b-4a8c-47eb-88e5-5aa2be035d1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:24.759396 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52bd0e8b-4a8c-47eb-88e5-5aa2be035d1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:24.789599 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-52bd0e8b-4a8c-47eb-88e5-5aa2be035d1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Jul 21 17:49:24.790164 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 359/712] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:24 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:49:24.866801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e128aa46-8ce6-4cd8-9f04-f2e91b5e2e10 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:24.874713 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e128aa46-8ce6-4cd8-9f04-f2e91b5e2e10 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149464 Jul 21 17:49:24.875278 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 354/713] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:24 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:25.801838 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-debd7d4b-d1ea-4780-b30a-393091a36e9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:25.802793 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-debd7d4b-d1ea-4780-b30a-393091a36e9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:25.809301 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-debd7d4b-d1ea-4780-b30a-393091a36e9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:25.809760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-debd7d4b-d1ea-4780-b30a-393091a36e9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:25.810796 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-debd7d4b-d1ea-4780-b30a-393091a36e9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:25.811336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-debd7d4b-d1ea-4780-b30a-393091a36e9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:25.841753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-debd7d4b-d1ea-4780-b30a-393091a36e9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Jul 21 17:49:25.842310 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 360/714] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:25 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:25.892979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dd495493-2486-4e0a-b3ee-3b6d3cbbfe0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:25.894104 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dd495493-2486-4e0a-b3ee-3b6d3cbbfe0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:25.900482 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd495493-2486-4e0a-b3ee-3b6d3cbbfe0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:25.900928 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd495493-2486-4e0a-b3ee-3b6d3cbbfe0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:25.901690 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd495493-2486-4e0a-b3ee-3b6d3cbbfe0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:25.902124 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd495493-2486-4e0a-b3ee-3b6d3cbbfe0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:26.031979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dd495493-2486-4e0a-b3ee-3b6d3cbbfe0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:26.040754 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dd495493-2486-4e0a-b3ee-3b6d3cbbfe0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151562 Jul 21 17:49:26.041329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 355/715] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:25 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:26.853206 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3c07925c-702d-448f-bbec-fc1b999b53a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:26.854134 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3c07925c-702d-448f-bbec-fc1b999b53a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:26.860599 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3c07925c-702d-448f-bbec-fc1b999b53a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:26.861051 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3c07925c-702d-448f-bbec-fc1b999b53a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:26.861839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3c07925c-702d-448f-bbec-fc1b999b53a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:26.862789 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3c07925c-702d-448f-bbec-fc1b999b53a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:26.891747 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3c07925c-702d-448f-bbec-fc1b999b53a8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042472 Jul 21 17:49:26.892281 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 361/716] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:26 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:27.057215 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-071b8903-3282-4dde-a095-2a46a214aa41 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:27.057764 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-071b8903-3282-4dde-a095-2a46a214aa41 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:27.064497 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-071b8903-3282-4dde-a095-2a46a214aa41 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:27.064958 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-071b8903-3282-4dde-a095-2a46a214aa41 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:27.065732 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-071b8903-3282-4dde-a095-2a46a214aa41 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:27.066428 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-071b8903-3282-4dde-a095-2a46a214aa41 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:27.195377 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-071b8903-3282-4dde-a095-2a46a214aa41 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:27.203230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-071b8903-3282-4dde-a095-2a46a214aa41 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149917 Jul 21 17:49:27.203803 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 356/717] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:27 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:49:27.903323 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1006d942-2438-40a4-8384-174e57593879 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:27.904327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1006d942-2438-40a4-8384-174e57593879 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:27.911002 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1006d942-2438-40a4-8384-174e57593879 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:27.911457 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1006d942-2438-40a4-8384-174e57593879 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:27.912232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1006d942-2438-40a4-8384-174e57593879 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:27.912710 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1006d942-2438-40a4-8384-174e57593879 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:27.942515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1006d942-2438-40a4-8384-174e57593879 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043260 Jul 21 17:49:27.943092 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 362/718] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:27 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:28.220137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-51205e2b-2acf-4184-8c94-313ca39de478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:28.220785 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-51205e2b-2acf-4184-8c94-313ca39de478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:28.227461 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51205e2b-2acf-4184-8c94-313ca39de478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:28.227913 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51205e2b-2acf-4184-8c94-313ca39de478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:28.228706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51205e2b-2acf-4184-8c94-313ca39de478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:28.229142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51205e2b-2acf-4184-8c94-313ca39de478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:28.354289 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-51205e2b-2acf-4184-8c94-313ca39de478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:28.362756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-51205e2b-2acf-4184-8c94-313ca39de478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.145768 Jul 21 17:49:28.363176 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 357/719] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:28 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:28.953969 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-496ed6b2-fc58-467b-aaa5-2eb666a9e471 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:28.954900 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-496ed6b2-fc58-467b-aaa5-2eb666a9e471 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:28.962247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-496ed6b2-fc58-467b-aaa5-2eb666a9e471 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:28.962696 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-496ed6b2-fc58-467b-aaa5-2eb666a9e471 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:28.963486 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-496ed6b2-fc58-467b-aaa5-2eb666a9e471 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:28.963921 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-496ed6b2-fc58-467b-aaa5-2eb666a9e471 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:28.993498 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-496ed6b2-fc58-467b-aaa5-2eb666a9e471 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043464 Jul 21 17:49:28.994053 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 363/720] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:28 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:29.380036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-793ba1bb-37ff-43fd-bdc0-f74aa15e223e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:29.380722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-793ba1bb-37ff-43fd-bdc0-f74aa15e223e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:29.387137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-793ba1bb-37ff-43fd-bdc0-f74aa15e223e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:29.387592 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-793ba1bb-37ff-43fd-bdc0-f74aa15e223e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:29.388383 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-793ba1bb-37ff-43fd-bdc0-f74aa15e223e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:29.388825 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-793ba1bb-37ff-43fd-bdc0-f74aa15e223e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:29.524125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-793ba1bb-37ff-43fd-bdc0-f74aa15e223e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:29.531934 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-793ba1bb-37ff-43fd-bdc0-f74aa15e223e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156286 Jul 21 17:49:29.532520 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 358/721] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:29 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:30.005311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4c3084ad-767c-41bd-b1dc-073fdf71114f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:30.006266 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4c3084ad-767c-41bd-b1dc-073fdf71114f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:30.012672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4c3084ad-767c-41bd-b1dc-073fdf71114f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:30.013120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4c3084ad-767c-41bd-b1dc-073fdf71114f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:30.013906 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4c3084ad-767c-41bd-b1dc-073fdf71114f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:30.014342 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4c3084ad-767c-41bd-b1dc-073fdf71114f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:30.042415 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4c3084ad-767c-41bd-b1dc-073fdf71114f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041404 Jul 21 17:49:30.042948 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 364/722] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:29 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:30.548477 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-558ec901-cbbb-49e1-88c6-74d4de961033 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:30.549099 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-558ec901-cbbb-49e1-88c6-74d4de961033 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:30.555544 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-558ec901-cbbb-49e1-88c6-74d4de961033 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:30.555994 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-558ec901-cbbb-49e1-88c6-74d4de961033 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:30.556774 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-558ec901-cbbb-49e1-88c6-74d4de961033 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:30.557209 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-558ec901-cbbb-49e1-88c6-74d4de961033 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:30.686563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-558ec901-cbbb-49e1-88c6-74d4de961033 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:30.695430 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-558ec901-cbbb-49e1-88c6-74d4de961033 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150951 Jul 21 17:49:30.696006 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 359/723] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:30 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:31.054148 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6a5c9bd5-1d9f-4699-932b-5b2ba1b07e0a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:31.055071 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6a5c9bd5-1d9f-4699-932b-5b2ba1b07e0a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:31.061133 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6a5c9bd5-1d9f-4699-932b-5b2ba1b07e0a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:31.061587 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6a5c9bd5-1d9f-4699-932b-5b2ba1b07e0a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:31.062351 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6a5c9bd5-1d9f-4699-932b-5b2ba1b07e0a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:31.062793 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6a5c9bd5-1d9f-4699-932b-5b2ba1b07e0a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:31.092035 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6a5c9bd5-1d9f-4699-932b-5b2ba1b07e0a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042090 Jul 21 17:49:31.092604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 365/724] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:31.712549 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7026e7d7-1674-4227-b124-38ef77ec5634 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:31.713233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7026e7d7-1674-4227-b124-38ef77ec5634 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:31.719254 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7026e7d7-1674-4227-b124-38ef77ec5634 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:31.719701 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7026e7d7-1674-4227-b124-38ef77ec5634 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:31.720483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7026e7d7-1674-4227-b124-38ef77ec5634 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:31.720922 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7026e7d7-1674-4227-b124-38ef77ec5634 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:32.075243 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7026e7d7-1674-4227-b124-38ef77ec5634 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:32.083652 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7026e7d7-1674-4227-b124-38ef77ec5634 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.374959 Jul 21 17:49:32.084207 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 360/725] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:31 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:32.103652 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-66b31572-d03c-4ac3-9ec6-4ec7d2894248 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:32.104593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-66b31572-d03c-4ac3-9ec6-4ec7d2894248 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:32.111060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-66b31572-d03c-4ac3-9ec6-4ec7d2894248 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:32.111504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-66b31572-d03c-4ac3-9ec6-4ec7d2894248 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:32.112329 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-66b31572-d03c-4ac3-9ec6-4ec7d2894248 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:32.112856 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-66b31572-d03c-4ac3-9ec6-4ec7d2894248 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:32.141256 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-66b31572-d03c-4ac3-9ec6-4ec7d2894248 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041464 Jul 21 17:49:32.141854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 366/726] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:32 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:33.100569 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3896c373-0df6-4fd8-b226-4dd87b7a0c68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:33.101374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3896c373-0df6-4fd8-b226-4dd87b7a0c68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:33.107829 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3896c373-0df6-4fd8-b226-4dd87b7a0c68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:33.108281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3896c373-0df6-4fd8-b226-4dd87b7a0c68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:33.109183 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3896c373-0df6-4fd8-b226-4dd87b7a0c68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:33.109620 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3896c373-0df6-4fd8-b226-4dd87b7a0c68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:33.153255 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5219e832-674f-4709-85b6-f38776fa9719 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:33.154215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5219e832-674f-4709-85b6-f38776fa9719 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:33.160774 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5219e832-674f-4709-85b6-f38776fa9719 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:33.161224 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5219e832-674f-4709-85b6-f38776fa9719 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:33.161995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5219e832-674f-4709-85b6-f38776fa9719 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:33.162433 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5219e832-674f-4709-85b6-f38776fa9719 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:33.192287 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5219e832-674f-4709-85b6-f38776fa9719 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 Jul 21 17:49:33.192889 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 367/727] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:33 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:49:33.239214 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3896c373-0df6-4fd8-b226-4dd87b7a0c68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:33.249476 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3896c373-0df6-4fd8-b226-4dd87b7a0c68 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152858 Jul 21 17:49:33.250034 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 361/728] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:33 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:34.202883 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bed00ac1-dec5-4874-8204-672671fab7f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:34.203808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bed00ac1-dec5-4874-8204-672671fab7f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:34.210991 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bed00ac1-dec5-4874-8204-672671fab7f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:34.211443 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bed00ac1-dec5-4874-8204-672671fab7f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:34.212207 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bed00ac1-dec5-4874-8204-672671fab7f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:34.212672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bed00ac1-dec5-4874-8204-672671fab7f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:34.226714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=100 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:34.242346 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bed00ac1-dec5-4874-8204-672671fab7f5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043400 Jul 21 17:49:34.242895 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 368/729] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:34 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:34.266850 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dde2d6ac-3ac2-44fa-b652-8fbf71706b83 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:34.267465 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dde2d6ac-3ac2-44fa-b652-8fbf71706b83 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:34.270297 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=70 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:34.276442 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dde2d6ac-3ac2-44fa-b652-8fbf71706b83 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:34.276901 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dde2d6ac-3ac2-44fa-b652-8fbf71706b83 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:34.277714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dde2d6ac-3ac2-44fa-b652-8fbf71706b83 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:34.278153 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dde2d6ac-3ac2-44fa-b652-8fbf71706b83 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:34.409574 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dde2d6ac-3ac2-44fa-b652-8fbf71706b83 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:34.417577 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dde2d6ac-3ac2-44fa-b652-8fbf71706b83 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154604 Jul 21 17:49:34.418145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 362/730] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:34 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:35.253616 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e8bdc1fa-6725-43aa-9b8c-33d38aa6774b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:35.254549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e8bdc1fa-6725-43aa-9b8c-33d38aa6774b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:35.261092 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e8bdc1fa-6725-43aa-9b8c-33d38aa6774b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:35.261545 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e8bdc1fa-6725-43aa-9b8c-33d38aa6774b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:35.262312 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e8bdc1fa-6725-43aa-9b8c-33d38aa6774b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:35.262753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e8bdc1fa-6725-43aa-9b8c-33d38aa6774b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:35.291551 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e8bdc1fa-6725-43aa-9b8c-33d38aa6774b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 Jul 21 17:49:35.292105 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 369/731] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:35 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:35.434095 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-90529663-9dd7-4f84-b678-d7ed5934f66c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:35.434646 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-90529663-9dd7-4f84-b678-d7ed5934f66c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:35.441962 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90529663-9dd7-4f84-b678-d7ed5934f66c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:35.442432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90529663-9dd7-4f84-b678-d7ed5934f66c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:35.443199 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90529663-9dd7-4f84-b678-d7ed5934f66c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:35.443636 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90529663-9dd7-4f84-b678-d7ed5934f66c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:35.573325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-90529663-9dd7-4f84-b678-d7ed5934f66c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:35.581827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-90529663-9dd7-4f84-b678-d7ed5934f66c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151593 Jul 21 17:49:35.582397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 363/732] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:35 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:36.303837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-70fec001-8e5e-4a45-bfe7-58812b8c684c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:36.304833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-70fec001-8e5e-4a45-bfe7-58812b8c684c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:36.307450 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=74 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:36.312933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-70fec001-8e5e-4a45-bfe7-58812b8c684c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:36.313390 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-70fec001-8e5e-4a45-bfe7-58812b8c684c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:36.314171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-70fec001-8e5e-4a45-bfe7-58812b8c684c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:36.314614 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-70fec001-8e5e-4a45-bfe7-58812b8c684c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:36.343708 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-70fec001-8e5e-4a45-bfe7-58812b8c684c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Jul 21 17:49:36.344265 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 370/733] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:36 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:36.599596 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5f194689-27ab-42ea-b919-24677fdacc53 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:36.600117 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5f194689-27ab-42ea-b919-24677fdacc53 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:36.606597 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5f194689-27ab-42ea-b919-24677fdacc53 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:36.607055 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5f194689-27ab-42ea-b919-24677fdacc53 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:36.607797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5f194689-27ab-42ea-b919-24677fdacc53 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:36.608231 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5f194689-27ab-42ea-b919-24677fdacc53 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:36.736767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5f194689-27ab-42ea-b919-24677fdacc53 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:36.744868 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5f194689-27ab-42ea-b919-24677fdacc53 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149789 Jul 21 17:49:36.745435 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 364/734] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:36 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:37.355940 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-38e046a4-6789-4a29-ac8c-2877e3b15c4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:37.356908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-38e046a4-6789-4a29-ac8c-2877e3b15c4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:37.364317 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-38e046a4-6789-4a29-ac8c-2877e3b15c4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:37.364777 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-38e046a4-6789-4a29-ac8c-2877e3b15c4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:37.365541 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-38e046a4-6789-4a29-ac8c-2877e3b15c4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:37.366016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-38e046a4-6789-4a29-ac8c-2877e3b15c4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:37.395710 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-38e046a4-6789-4a29-ac8c-2877e3b15c4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043594 Jul 21 17:49:37.396265 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 371/735] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:37 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:37.762259 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5a37dc7e-6b20-4a7d-b2e9-01a8337fa53b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:37.763003 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5a37dc7e-6b20-4a7d-b2e9-01a8337fa53b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:37.770031 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a37dc7e-6b20-4a7d-b2e9-01a8337fa53b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:37.770484 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a37dc7e-6b20-4a7d-b2e9-01a8337fa53b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:37.771298 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a37dc7e-6b20-4a7d-b2e9-01a8337fa53b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:37.771742 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a37dc7e-6b20-4a7d-b2e9-01a8337fa53b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:37.904249 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5a37dc7e-6b20-4a7d-b2e9-01a8337fa53b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:37.913217 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5a37dc7e-6b20-4a7d-b2e9-01a8337fa53b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154815 Jul 21 17:49:37.913797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 365/736] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:37 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:38.407085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-607014ec-cdac-4749-814c-925cfc53cc4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:38.408041 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-607014ec-cdac-4749-814c-925cfc53cc4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:38.414775 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-607014ec-cdac-4749-814c-925cfc53cc4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:38.415225 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-607014ec-cdac-4749-814c-925cfc53cc4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:38.415982 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-607014ec-cdac-4749-814c-925cfc53cc4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:38.416448 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-607014ec-cdac-4749-814c-925cfc53cc4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:38.445929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-607014ec-cdac-4749-814c-925cfc53cc4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042734 Jul 21 17:49:38.446470 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 372/737] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:38 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:38.930493 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-195d124a-6211-45a1-9b76-9f2cc971198b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:38.931222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-195d124a-6211-45a1-9b76-9f2cc971198b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:38.937869 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-195d124a-6211-45a1-9b76-9f2cc971198b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:38.938322 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-195d124a-6211-45a1-9b76-9f2cc971198b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:38.939090 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-195d124a-6211-45a1-9b76-9f2cc971198b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:38.939530 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-195d124a-6211-45a1-9b76-9f2cc971198b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:39.069056 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-195d124a-6211-45a1-9b76-9f2cc971198b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:39.076972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-195d124a-6211-45a1-9b76-9f2cc971198b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150361 Jul 21 17:49:39.077540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 366/738] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:38 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:39.457703 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c8623862-23d7-4dfe-94dc-8f20383b3e53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:39.458630 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c8623862-23d7-4dfe-94dc-8f20383b3e53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:39.465407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c8623862-23d7-4dfe-94dc-8f20383b3e53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:39.465853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c8623862-23d7-4dfe-94dc-8f20383b3e53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:39.466618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c8623862-23d7-4dfe-94dc-8f20383b3e53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:39.467051 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c8623862-23d7-4dfe-94dc-8f20383b3e53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:39.496503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c8623862-23d7-4dfe-94dc-8f20383b3e53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042876 Jul 21 17:49:39.497212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 373/739] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:39 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:40.094088 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5dfd7979-4f08-420d-9d01-021151e8d5ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:40.094656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5dfd7979-4f08-420d-9d01-021151e8d5ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:40.101684 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5dfd7979-4f08-420d-9d01-021151e8d5ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:40.102127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5dfd7979-4f08-420d-9d01-021151e8d5ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:40.102891 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5dfd7979-4f08-420d-9d01-021151e8d5ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:40.103323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5dfd7979-4f08-420d-9d01-021151e8d5ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:40.105866 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:40.241778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5dfd7979-4f08-420d-9d01-021151e8d5ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:40.249907 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5dfd7979-4f08-420d-9d01-021151e8d5ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.159780 Jul 21 17:49:40.250471 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 367/740] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:40 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:40.508784 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-52353057-82fe-40a3-ac5b-7dd2fe78223d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:40.509707 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-52353057-82fe-40a3-ac5b-7dd2fe78223d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:40.516117 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52353057-82fe-40a3-ac5b-7dd2fe78223d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:40.516606 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52353057-82fe-40a3-ac5b-7dd2fe78223d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:40.517362 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52353057-82fe-40a3-ac5b-7dd2fe78223d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:40.517798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52353057-82fe-40a3-ac5b-7dd2fe78223d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:40.546549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-52353057-82fe-40a3-ac5b-7dd2fe78223d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041675 Jul 21 17:49:40.547087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 374/741] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:41.266692 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6711b36f-f9ee-4d95-9436-59b0a8fb825c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:41.267305 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6711b36f-f9ee-4d95-9436-59b0a8fb825c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:41.274409 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6711b36f-f9ee-4d95-9436-59b0a8fb825c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:41.274856 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6711b36f-f9ee-4d95-9436-59b0a8fb825c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:41.275617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6711b36f-f9ee-4d95-9436-59b0a8fb825c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:41.276073 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6711b36f-f9ee-4d95-9436-59b0a8fb825c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:41.402678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6711b36f-f9ee-4d95-9436-59b0a8fb825c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:41.410658 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6711b36f-f9ee-4d95-9436-59b0a8fb825c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147807 Jul 21 17:49:41.411239 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 368/742] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:41 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:41.559343 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-eb49ca73-7c8c-4318-914d-0c7a4cf2d457 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:41.560581 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-eb49ca73-7c8c-4318-914d-0c7a4cf2d457 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:41.567874 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-eb49ca73-7c8c-4318-914d-0c7a4cf2d457 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:41.568368 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-eb49ca73-7c8c-4318-914d-0c7a4cf2d457 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:41.569136 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-eb49ca73-7c8c-4318-914d-0c7a4cf2d457 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:41.569576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-eb49ca73-7c8c-4318-914d-0c7a4cf2d457 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:41.600249 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-eb49ca73-7c8c-4318-914d-0c7a4cf2d457 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045671 Jul 21 17:49:41.600928 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 375/743] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:41 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:42.427183 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b547f968-4e82-4777-9cdc-3e7faee155c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:42.427802 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b547f968-4e82-4777-9cdc-3e7faee155c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:42.434331 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b547f968-4e82-4777-9cdc-3e7faee155c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:42.434841 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b547f968-4e82-4777-9cdc-3e7faee155c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:42.435608 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b547f968-4e82-4777-9cdc-3e7faee155c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:42.436052 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b547f968-4e82-4777-9cdc-3e7faee155c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:42.568711 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b547f968-4e82-4777-9cdc-3e7faee155c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:42.576595 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b547f968-4e82-4777-9cdc-3e7faee155c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153607 Jul 21 17:49:42.577165 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 369/744] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:42 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:42.610941 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1535d6d7-6a71-4529-ae94-6fe20bfde525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:42.612084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1535d6d7-6a71-4529-ae94-6fe20bfde525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:42.618629 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1535d6d7-6a71-4529-ae94-6fe20bfde525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:42.619089 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1535d6d7-6a71-4529-ae94-6fe20bfde525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:42.619859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1535d6d7-6a71-4529-ae94-6fe20bfde525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:42.620320 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1535d6d7-6a71-4529-ae94-6fe20bfde525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:42.649125 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1535d6d7-6a71-4529-ae94-6fe20bfde525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042088 Jul 21 17:49:42.649668 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 376/745] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:42 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:43.594103 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3df68ff6-f86d-4fcd-bb46-160491f8fee4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:43.594714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3df68ff6-f86d-4fcd-bb46-160491f8fee4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:43.601722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3df68ff6-f86d-4fcd-bb46-160491f8fee4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:43.602165 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3df68ff6-f86d-4fcd-bb46-160491f8fee4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:43.602930 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3df68ff6-f86d-4fcd-bb46-160491f8fee4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:43.603367 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3df68ff6-f86d-4fcd-bb46-160491f8fee4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:43.661843 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-42416fa4-09aa-47d9-a852-3897f308ded2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:43.662943 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-42416fa4-09aa-47d9-a852-3897f308ded2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:43.669398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-42416fa4-09aa-47d9-a852-3897f308ded2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:43.669852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-42416fa4-09aa-47d9-a852-3897f308ded2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:43.670796 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-42416fa4-09aa-47d9-a852-3897f308ded2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:43.671238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-42416fa4-09aa-47d9-a852-3897f308ded2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:43.701447 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-42416fa4-09aa-47d9-a852-3897f308ded2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044635 Jul 21 17:49:43.702010 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 377/746] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 17:49:43.733952 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3df68ff6-f86d-4fcd-bb46-160491f8fee4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:43.742668 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3df68ff6-f86d-4fcd-bb46-160491f8fee4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152328 Jul 21 17:49:43.743240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 370/747] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:43 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:44.712979 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e2f96311-e23a-4608-8bf7-c924d78885a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:44.713901 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e2f96311-e23a-4608-8bf7-c924d78885a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:44.720262 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2f96311-e23a-4608-8bf7-c924d78885a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:44.720741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2f96311-e23a-4608-8bf7-c924d78885a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:44.721496 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2f96311-e23a-4608-8bf7-c924d78885a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:44.721930 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2f96311-e23a-4608-8bf7-c924d78885a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:44.750988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e2f96311-e23a-4608-8bf7-c924d78885a2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 Jul 21 17:49:44.751538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 378/748] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:44 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:44.760584 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f19839f3-d753-4777-9454-1bfc051d3d26 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:44.761205 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f19839f3-d753-4777-9454-1bfc051d3d26 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:44.767683 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f19839f3-d753-4777-9454-1bfc051d3d26 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:44.768131 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f19839f3-d753-4777-9454-1bfc051d3d26 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:44.768936 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f19839f3-d753-4777-9454-1bfc051d3d26 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:44.769375 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f19839f3-d753-4777-9454-1bfc051d3d26 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:44.900348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f19839f3-d753-4777-9454-1bfc051d3d26 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:44.908254 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f19839f3-d753-4777-9454-1bfc051d3d26 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151587 Jul 21 17:49:44.908840 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 371/749] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:44 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:45.763289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1183f24f-16e7-44d8-ac0a-320bd7795594 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:45.764210 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1183f24f-16e7-44d8-ac0a-320bd7795594 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:45.771438 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1183f24f-16e7-44d8-ac0a-320bd7795594 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:45.771887 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1183f24f-16e7-44d8-ac0a-320bd7795594 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:45.772675 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1183f24f-16e7-44d8-ac0a-320bd7795594 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:45.773113 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1183f24f-16e7-44d8-ac0a-320bd7795594 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:45.800712 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1183f24f-16e7-44d8-ac0a-320bd7795594 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041708 Jul 21 17:49:45.801256 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 379/750] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:45 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:45.925224 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fd707ddd-4957-4680-ae94-35cf8400a4bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:45.925887 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fd707ddd-4957-4680-ae94-35cf8400a4bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:45.932656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd707ddd-4957-4680-ae94-35cf8400a4bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:45.933110 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd707ddd-4957-4680-ae94-35cf8400a4bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:45.933886 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd707ddd-4957-4680-ae94-35cf8400a4bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:45.934325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd707ddd-4957-4680-ae94-35cf8400a4bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:46.068033 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fd707ddd-4957-4680-ae94-35cf8400a4bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:46.075872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fd707ddd-4957-4680-ae94-35cf8400a4bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154678 Jul 21 17:49:46.076456 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 372/751] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:45 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:46.811924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-055cb9e7-33c4-469a-a10a-91b631fb6794 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:46.812907 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-055cb9e7-33c4-469a-a10a-91b631fb6794 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:46.819759 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-055cb9e7-33c4-469a-a10a-91b631fb6794 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:46.820212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-055cb9e7-33c4-469a-a10a-91b631fb6794 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:46.821007 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-055cb9e7-33c4-469a-a10a-91b631fb6794 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:46.821448 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-055cb9e7-33c4-469a-a10a-91b631fb6794 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:46.850691 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-055cb9e7-33c4-469a-a10a-91b631fb6794 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042742 Jul 21 17:49:46.851237 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 380/752] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:46 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:47.093169 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-27309ab2-fe4a-43c7-befe-02c41b022810 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:47.093716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-27309ab2-fe4a-43c7-befe-02c41b022810 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:47.101180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27309ab2-fe4a-43c7-befe-02c41b022810 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:47.101633 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27309ab2-fe4a-43c7-befe-02c41b022810 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:47.102400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27309ab2-fe4a-43c7-befe-02c41b022810 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:47.102841 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27309ab2-fe4a-43c7-befe-02c41b022810 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:47.230087 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-27309ab2-fe4a-43c7-befe-02c41b022810 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:47.238018 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-27309ab2-fe4a-43c7-befe-02c41b022810 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148856 Jul 21 17:49:47.238616 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 373/753] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:47 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:47.862172 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c72a78d1-9aea-402e-81c2-bf446a15646b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:47.863138 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c72a78d1-9aea-402e-81c2-bf446a15646b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:47.870331 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c72a78d1-9aea-402e-81c2-bf446a15646b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:47.870789 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c72a78d1-9aea-402e-81c2-bf446a15646b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:47.871562 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c72a78d1-9aea-402e-81c2-bf446a15646b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:47.872002 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c72a78d1-9aea-402e-81c2-bf446a15646b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:47.900932 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c72a78d1-9aea-402e-81c2-bf446a15646b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042754 Jul 21 17:49:47.901491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 381/754] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:47.933791 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d7dfb69b-e9d1-4459-89c2-bd2728d313f1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:47.934298 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d7dfb69b-e9d1-4459-89c2-bd2728d313f1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:47.940438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d7dfb69b-e9d1-4459-89c2-bd2728d313f1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:47.941144 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d7dfb69b-e9d1-4459-89c2-bd2728d313f1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:47.941919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d7dfb69b-e9d1-4459-89c2-bd2728d313f1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:47.942360 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d7dfb69b-e9d1-4459-89c2-bd2728d313f1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:47.964527 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d7dfb69b-e9d1-4459-89c2-bd2728d313f1 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c/ips" status: 200 len: 149 microversion: 2.1 time: 0.034531 Jul 21 17:49:47.965093 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 374/755] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 17:49:47 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:48.255280 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-95be82e1-aa13-4dba-b5bf-7637ebff5466 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:48.255887 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-95be82e1-aa13-4dba-b5bf-7637ebff5466 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:48.262327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-95be82e1-aa13-4dba-b5bf-7637ebff5466 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:48.262775 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-95be82e1-aa13-4dba-b5bf-7637ebff5466 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:48.263534 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-95be82e1-aa13-4dba-b5bf-7637ebff5466 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:48.263973 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-95be82e1-aa13-4dba-b5bf-7637ebff5466 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:48.396140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-95be82e1-aa13-4dba-b5bf-7637ebff5466 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:48.404088 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-95be82e1-aa13-4dba-b5bf-7637ebff5466 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152981 Jul 21 17:49:48.404679 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 382/756] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:48 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:48.912186 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-44b4f723-d672-4f86-97b2-06b33019934e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:48.913204 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-44b4f723-d672-4f86-97b2-06b33019934e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:48.919663 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44b4f723-d672-4f86-97b2-06b33019934e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:48.920107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44b4f723-d672-4f86-97b2-06b33019934e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:48.920905 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44b4f723-d672-4f86-97b2-06b33019934e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:48.921339 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44b4f723-d672-4f86-97b2-06b33019934e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:48.951286 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-44b4f723-d672-4f86-97b2-06b33019934e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043157 Jul 21 17:49:48.951836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 375/757] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:48 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:49.421894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-798e9cc4-00b8-445d-a6b7-049c1a0949a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:49.422565 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-798e9cc4-00b8-445d-a6b7-049c1a0949a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:49.429848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-798e9cc4-00b8-445d-a6b7-049c1a0949a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:49.430306 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-798e9cc4-00b8-445d-a6b7-049c1a0949a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:49.431080 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-798e9cc4-00b8-445d-a6b7-049c1a0949a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:49.431525 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-798e9cc4-00b8-445d-a6b7-049c1a0949a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:49.559421 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-798e9cc4-00b8-445d-a6b7-049c1a0949a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:49.567603 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-798e9cc4-00b8-445d-a6b7-049c1a0949a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149717 Jul 21 17:49:49.568164 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 383/758] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:49 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:49.962546 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-68e563d5-aa5f-46e6-b31d-6158e6560699 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:49.963501 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-68e563d5-aa5f-46e6-b31d-6158e6560699 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:49.969995 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68e563d5-aa5f-46e6-b31d-6158e6560699 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:49.970449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68e563d5-aa5f-46e6-b31d-6158e6560699 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:49.971214 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68e563d5-aa5f-46e6-b31d-6158e6560699 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:49.971655 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68e563d5-aa5f-46e6-b31d-6158e6560699 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:50.000893 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-68e563d5-aa5f-46e6-b31d-6158e6560699 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042304 Jul 21 17:49:50.001455 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 376/759] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 17:49:49 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:49:50.584668 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a89e95be-0907-459e-8316-f3413028e8f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:50.585197 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a89e95be-0907-459e-8316-f3413028e8f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:50.591622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a89e95be-0907-459e-8316-f3413028e8f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:50.592070 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a89e95be-0907-459e-8316-f3413028e8f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:50.592858 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a89e95be-0907-459e-8316-f3413028e8f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:50.593292 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a89e95be-0907-459e-8316-f3413028e8f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:50.719509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a89e95be-0907-459e-8316-f3413028e8f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:50.727455 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a89e95be-0907-459e-8316-f3413028e8f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.146975 Jul 21 17:49:50.728042 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 384/760] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:50 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:51.013272 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2463185d-d46b-40c8-84c1-befc738ad4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:49:51.014236 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2463185d-d46b-40c8-84c1-befc738ad4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:51.020789 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2463185d-d46b-40c8-84c1-befc738ad4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:51.021253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2463185d-d46b-40c8-84c1-befc738ad4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:51.022021 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2463185d-d46b-40c8-84c1-befc738ad4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:51.022469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2463185d-d46b-40c8-84c1-befc738ad4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:51.113745 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2463185d-d46b-40c8-84c1-befc738ad4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "POST /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/action" status: 200 len: 76596 microversion: 2.1 time: 0.104220 Jul 21 17:49:51.114373 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 377/761] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 17:49:51 2022] POST /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e/action => generated 76596 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:49:51.744105 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cb6d48c8-6e62-4baf-93b8-3142a0c02720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:51.744763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cb6d48c8-6e62-4baf-93b8-3142a0c02720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:51.751191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb6d48c8-6e62-4baf-93b8-3142a0c02720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:51.751646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb6d48c8-6e62-4baf-93b8-3142a0c02720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:51.752439 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb6d48c8-6e62-4baf-93b8-3142a0c02720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:51.752881 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb6d48c8-6e62-4baf-93b8-3142a0c02720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:51.755421 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=100 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:49:51.892840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-cb6d48c8-6e62-4baf-93b8-3142a0c02720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:51.901383 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cb6d48c8-6e62-4baf-93b8-3142a0c02720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.161073 Jul 21 17:49:51.901945 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 385/762] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:51 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:52.919591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-afafa68b-997b-48b7-bdd8-702237f2b9ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:52.920315 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-afafa68b-997b-48b7-bdd8-702237f2b9ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:52.927446 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-afafa68b-997b-48b7-bdd8-702237f2b9ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:52.927998 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-afafa68b-997b-48b7-bdd8-702237f2b9ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:52.928830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-afafa68b-997b-48b7-bdd8-702237f2b9ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:52.929275 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-afafa68b-997b-48b7-bdd8-702237f2b9ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:53.065806 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-afafa68b-997b-48b7-bdd8-702237f2b9ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:53.074611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-afafa68b-997b-48b7-bdd8-702237f2b9ce tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.159252 Jul 21 17:49:53.075169 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 378/763] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:52 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:54.137086 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8506a891-2624-44a5-b641-a703222bb343 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:54.137819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8506a891-2624-44a5-b641-a703222bb343 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:54.143736 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8506a891-2624-44a5-b641-a703222bb343 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:54.144194 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8506a891-2624-44a5-b641-a703222bb343 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:54.144987 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8506a891-2624-44a5-b641-a703222bb343 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:54.145425 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8506a891-2624-44a5-b641-a703222bb343 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:54.282315 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8506a891-2624-44a5-b641-a703222bb343 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:54.291238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8506a891-2624-44a5-b641-a703222bb343 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.203151 Jul 21 17:49:54.291749 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 386/764] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:54 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:55.309873 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1fb62465-83b0-4bcb-8de4-658468d8dd6d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:55.310833 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1fb62465-83b0-4bcb-8de4-658468d8dd6d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:55.331017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1fb62465-83b0-4bcb-8de4-658468d8dd6d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:55.331484 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1fb62465-83b0-4bcb-8de4-658468d8dd6d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:55.332284 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1fb62465-83b0-4bcb-8de4-658468d8dd6d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:55.332752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1fb62465-83b0-4bcb-8de4-658468d8dd6d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:55.463057 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1fb62465-83b0-4bcb-8de4-658468d8dd6d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:55.470914 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1fb62465-83b0-4bcb-8de4-658468d8dd6d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.166108 Jul 21 17:49:55.471475 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 379/765] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:55 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:49:56.487340 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cc61e517-ede4-4098-b93c-3898f9a4ca93 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:56.487948 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cc61e517-ede4-4098-b93c-3898f9a4ca93 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:56.494480 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cc61e517-ede4-4098-b93c-3898f9a4ca93 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:56.494922 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cc61e517-ede4-4098-b93c-3898f9a4ca93 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:56.495716 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cc61e517-ede4-4098-b93c-3898f9a4ca93 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:56.496146 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cc61e517-ede4-4098-b93c-3898f9a4ca93 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:56.629587 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-cc61e517-ede4-4098-b93c-3898f9a4ca93 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:56.638208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cc61e517-ede4-4098-b93c-3898f9a4ca93 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154580 Jul 21 17:49:56.638716 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 387/766] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:56 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:57.656619 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-27344165-6705-4c98-9b12-92d1a618cef8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:57.657265 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-27344165-6705-4c98-9b12-92d1a618cef8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:57.664493 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27344165-6705-4c98-9b12-92d1a618cef8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:57.664942 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27344165-6705-4c98-9b12-92d1a618cef8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:57.665701 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27344165-6705-4c98-9b12-92d1a618cef8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:57.666132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27344165-6705-4c98-9b12-92d1a618cef8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:57.791864 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-27344165-6705-4c98-9b12-92d1a618cef8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:57.799661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-27344165-6705-4c98-9b12-92d1a618cef8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147454 Jul 21 17:49:57.800226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 380/767] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:57 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:58.815891 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-566b4948-2e68-4661-94df-20a586eb21d3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:58.816714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-566b4948-2e68-4661-94df-20a586eb21d3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:58.824013 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-566b4948-2e68-4661-94df-20a586eb21d3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:58.824498 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-566b4948-2e68-4661-94df-20a586eb21d3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:58.825258 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-566b4948-2e68-4661-94df-20a586eb21d3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:58.825691 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-566b4948-2e68-4661-94df-20a586eb21d3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:58.953643 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-566b4948-2e68-4661-94df-20a586eb21d3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:49:58.962360 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-566b4948-2e68-4661-94df-20a586eb21d3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150367 Jul 21 17:49:58.962918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 388/768] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:58 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:49:59.980001 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5c801e03-70fc-48d8-824f-7c1f20e290a9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:49:59.980653 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5c801e03-70fc-48d8-824f-7c1f20e290a9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:49:59.987172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c801e03-70fc-48d8-824f-7c1f20e290a9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:59.987620 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c801e03-70fc-48d8-824f-7c1f20e290a9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:49:59.988403 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c801e03-70fc-48d8-824f-7c1f20e290a9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:49:59.988856 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c801e03-70fc-48d8-824f-7c1f20e290a9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:00.122119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5c801e03-70fc-48d8-824f-7c1f20e290a9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:00.130093 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5c801e03-70fc-48d8-824f-7c1f20e290a9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153971 Jul 21 17:50:00.130651 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 381/769] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:49:59 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:01.147477 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5ca913ea-69b4-4c11-853c-2749c1505baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:01.148093 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5ca913ea-69b4-4c11-853c-2749c1505baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:01.154337 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ca913ea-69b4-4c11-853c-2749c1505baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:01.154794 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ca913ea-69b4-4c11-853c-2749c1505baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:01.155568 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ca913ea-69b4-4c11-853c-2749c1505baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:01.156010 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ca913ea-69b4-4c11-853c-2749c1505baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:01.284356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5ca913ea-69b4-4c11-853c-2749c1505baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:01.292853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5ca913ea-69b4-4c11-853c-2749c1505baf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149530 Jul 21 17:50:01.293411 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 389/770] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:01 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:02.309848 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dd376ea4-0359-430e-bd9d-94f57bd751bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:02.310358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dd376ea4-0359-430e-bd9d-94f57bd751bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:02.317116 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd376ea4-0359-430e-bd9d-94f57bd751bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:02.317562 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd376ea4-0359-430e-bd9d-94f57bd751bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:02.318933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd376ea4-0359-430e-bd9d-94f57bd751bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:02.319364 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd376ea4-0359-430e-bd9d-94f57bd751bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:02.454260 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dd376ea4-0359-430e-bd9d-94f57bd751bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:02.462798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dd376ea4-0359-430e-bd9d-94f57bd751bb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156488 Jul 21 17:50:02.463350 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 382/771] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:02 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:03.480682 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2d3ab7c1-abf4-4883-9662-950e3af0455e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:03.481366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2d3ab7c1-abf4-4883-9662-950e3af0455e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:03.487669 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d3ab7c1-abf4-4883-9662-950e3af0455e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:03.488118 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d3ab7c1-abf4-4883-9662-950e3af0455e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:03.488913 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d3ab7c1-abf4-4883-9662-950e3af0455e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:03.489345 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d3ab7c1-abf4-4883-9662-950e3af0455e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:03.619762 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2d3ab7c1-abf4-4883-9662-950e3af0455e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:03.627593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2d3ab7c1-abf4-4883-9662-950e3af0455e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150888 Jul 21 17:50:03.628153 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 390/772] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:03 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:04.645179 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b7913429-e481-4b86-b6f5-7d28c22515c3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:04.645797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b7913429-e481-4b86-b6f5-7d28c22515c3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:04.649160 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=42 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:50:04.654544 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b7913429-e481-4b86-b6f5-7d28c22515c3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:04.654996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b7913429-e481-4b86-b6f5-7d28c22515c3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:04.655767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b7913429-e481-4b86-b6f5-7d28c22515c3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:04.656209 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b7913429-e481-4b86-b6f5-7d28c22515c3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:04.782683 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b7913429-e481-4b86-b6f5-7d28c22515c3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:04.791064 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b7913429-e481-4b86-b6f5-7d28c22515c3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149684 Jul 21 17:50:04.791634 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 383/773] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:04 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:05.808639 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5f22cfb3-1856-475e-8f72-46df921a6842 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:05.809283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5f22cfb3-1856-475e-8f72-46df921a6842 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:05.816407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5f22cfb3-1856-475e-8f72-46df921a6842 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:05.816749 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5f22cfb3-1856-475e-8f72-46df921a6842 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:05.817515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5f22cfb3-1856-475e-8f72-46df921a6842 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:05.817956 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5f22cfb3-1856-475e-8f72-46df921a6842 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:05.951843 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5f22cfb3-1856-475e-8f72-46df921a6842 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:05.960510 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5f22cfb3-1856-475e-8f72-46df921a6842 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155259 Jul 21 17:50:05.961069 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 391/774] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:05 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:06.976898 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-024f9b36-83f9-48fa-83a1-0a703f41b9dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:06.977512 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-024f9b36-83f9-48fa-83a1-0a703f41b9dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:06.983944 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-024f9b36-83f9-48fa-83a1-0a703f41b9dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:06.984431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-024f9b36-83f9-48fa-83a1-0a703f41b9dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:06.985198 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-024f9b36-83f9-48fa-83a1-0a703f41b9dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:06.985632 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-024f9b36-83f9-48fa-83a1-0a703f41b9dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:07.000702 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:50:07.120678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-024f9b36-83f9-48fa-83a1-0a703f41b9dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:07.128593 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-024f9b36-83f9-48fa-83a1-0a703f41b9dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155433 Jul 21 17:50:07.129183 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 384/775] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:06 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:08.145255 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a97a3314-cd0e-4df0-9ab2-22ff7b51ecb5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:08.145870 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a97a3314-cd0e-4df0-9ab2-22ff7b51ecb5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:08.149793 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=44 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:50:08.153912 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a97a3314-cd0e-4df0-9ab2-22ff7b51ecb5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:08.154367 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a97a3314-cd0e-4df0-9ab2-22ff7b51ecb5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:08.155179 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a97a3314-cd0e-4df0-9ab2-22ff7b51ecb5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:08.155578 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a97a3314-cd0e-4df0-9ab2-22ff7b51ecb5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:08.286213 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a97a3314-cd0e-4df0-9ab2-22ff7b51ecb5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:08.294488 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a97a3314-cd0e-4df0-9ab2-22ff7b51ecb5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152970 Jul 21 17:50:08.295052 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 392/776] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:08 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:09.312232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b8617bdd-e0af-4ac7-9b51-df6ce58f4420 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:09.312808 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b8617bdd-e0af-4ac7-9b51-df6ce58f4420 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:09.320146 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8617bdd-e0af-4ac7-9b51-df6ce58f4420 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:09.320623 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8617bdd-e0af-4ac7-9b51-df6ce58f4420 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:09.321379 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8617bdd-e0af-4ac7-9b51-df6ce58f4420 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:09.321814 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8617bdd-e0af-4ac7-9b51-df6ce58f4420 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:09.449076 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b8617bdd-e0af-4ac7-9b51-df6ce58f4420 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:09.456940 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b8617bdd-e0af-4ac7-9b51-df6ce58f4420 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148575 Jul 21 17:50:09.457507 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 385/777] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:09 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:10.474336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-52130575-91c6-4e4c-b083-09124b6a57e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:10.474957 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-52130575-91c6-4e4c-b083-09124b6a57e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:10.481951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52130575-91c6-4e4c-b083-09124b6a57e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:10.482404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52130575-91c6-4e4c-b083-09124b6a57e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:10.483183 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52130575-91c6-4e4c-b083-09124b6a57e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:10.483629 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52130575-91c6-4e4c-b083-09124b6a57e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:10.618381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-52130575-91c6-4e4c-b083-09124b6a57e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:10.627692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-52130575-91c6-4e4c-b083-09124b6a57e7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.157367 Jul 21 17:50:10.628261 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 393/778] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:10 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:11.645205 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5755a4fb-ffb3-4cf9-b0ce-edfbb9517202 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:11.645815 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5755a4fb-ffb3-4cf9-b0ce-edfbb9517202 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:11.653071 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5755a4fb-ffb3-4cf9-b0ce-edfbb9517202 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:11.653515 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5755a4fb-ffb3-4cf9-b0ce-edfbb9517202 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:11.654272 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5755a4fb-ffb3-4cf9-b0ce-edfbb9517202 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:11.654704 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5755a4fb-ffb3-4cf9-b0ce-edfbb9517202 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:11.783229 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5755a4fb-ffb3-4cf9-b0ce-edfbb9517202 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:11.791325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5755a4fb-ffb3-4cf9-b0ce-edfbb9517202 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149997 Jul 21 17:50:11.791891 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 386/779] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:11 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:12.808541 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-885e20a2-b6b9-46b1-942d-e506f8651bf2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:12.809092 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-885e20a2-b6b9-46b1-942d-e506f8651bf2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:12.815671 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-885e20a2-b6b9-46b1-942d-e506f8651bf2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:12.816424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-885e20a2-b6b9-46b1-942d-e506f8651bf2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:12.817199 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-885e20a2-b6b9-46b1-942d-e506f8651bf2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:12.817641 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-885e20a2-b6b9-46b1-942d-e506f8651bf2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:12.947480 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-885e20a2-b6b9-46b1-942d-e506f8651bf2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:12.955354 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-885e20a2-b6b9-46b1-942d-e506f8651bf2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150733 Jul 21 17:50:12.955919 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 394/780] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:12 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:50:13.972712 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-97f131d5-ce00-4f7b-9251-3295a755a58f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:13.973339 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-97f131d5-ce00-4f7b-9251-3295a755a58f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:13.981002 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97f131d5-ce00-4f7b-9251-3295a755a58f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:13.981451 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97f131d5-ce00-4f7b-9251-3295a755a58f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:13.982251 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97f131d5-ce00-4f7b-9251-3295a755a58f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:13.982684 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97f131d5-ce00-4f7b-9251-3295a755a58f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:14.118648 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-97f131d5-ce00-4f7b-9251-3295a755a58f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:14.126563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-97f131d5-ce00-4f7b-9251-3295a755a58f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.157593 Jul 21 17:50:14.127126 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 387/781] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:13 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:15.142999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-aaff3572-222f-4ff5-958f-91ff5d276613 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:15.143623 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-aaff3572-222f-4ff5-958f-91ff5d276613 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:15.150614 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aaff3572-222f-4ff5-958f-91ff5d276613 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:15.151065 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aaff3572-222f-4ff5-958f-91ff5d276613 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:15.151830 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aaff3572-222f-4ff5-958f-91ff5d276613 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:15.152267 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aaff3572-222f-4ff5-958f-91ff5d276613 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:15.283800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-aaff3572-222f-4ff5-958f-91ff5d276613 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:15.292410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-aaff3572-222f-4ff5-958f-91ff5d276613 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153274 Jul 21 17:50:15.292977 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 395/782] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:15 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:16.309725 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-03d1647c-a4aa-401e-805a-fcfdfad5e76a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:16.310254 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-03d1647c-a4aa-401e-805a-fcfdfad5e76a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:16.317245 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-03d1647c-a4aa-401e-805a-fcfdfad5e76a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:16.317690 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-03d1647c-a4aa-401e-805a-fcfdfad5e76a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:16.318528 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-03d1647c-a4aa-401e-805a-fcfdfad5e76a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:16.319470 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-03d1647c-a4aa-401e-805a-fcfdfad5e76a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:16.474486 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-03d1647c-a4aa-401e-805a-fcfdfad5e76a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:16.486548 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-03d1647c-a4aa-401e-805a-fcfdfad5e76a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.180867 Jul 21 17:50:16.487130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 388/783] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:16 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:17.504239 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-aeee7f61-c9ab-48f4-b129-3d5153ad8720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:17.505114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-aeee7f61-c9ab-48f4-b129-3d5153ad8720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:17.512595 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aeee7f61-c9ab-48f4-b129-3d5153ad8720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:17.513044 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aeee7f61-c9ab-48f4-b129-3d5153ad8720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:17.513841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aeee7f61-c9ab-48f4-b129-3d5153ad8720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:17.514279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aeee7f61-c9ab-48f4-b129-3d5153ad8720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:17.644548 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-aeee7f61-c9ab-48f4-b129-3d5153ad8720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:17.652632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-aeee7f61-c9ab-48f4-b129-3d5153ad8720 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152162 Jul 21 17:50:17.653199 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 396/784] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:17 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:18.669420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c96aa29a-6cdf-4144-a8fb-781968c7c357 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:18.670035 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c96aa29a-6cdf-4144-a8fb-781968c7c357 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:18.676583 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c96aa29a-6cdf-4144-a8fb-781968c7c357 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:18.677035 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c96aa29a-6cdf-4144-a8fb-781968c7c357 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:18.677797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c96aa29a-6cdf-4144-a8fb-781968c7c357 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:18.679193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c96aa29a-6cdf-4144-a8fb-781968c7c357 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:18.805546 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c96aa29a-6cdf-4144-a8fb-781968c7c357 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:18.813379 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c96aa29a-6cdf-4144-a8fb-781968c7c357 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147767 Jul 21 17:50:18.813938 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 389/785] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:18 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:19.831586 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4b38f0bf-86a3-4552-8137-e73a6cdbe6a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:19.832112 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4b38f0bf-86a3-4552-8137-e73a6cdbe6a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:19.839756 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4b38f0bf-86a3-4552-8137-e73a6cdbe6a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:19.840207 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4b38f0bf-86a3-4552-8137-e73a6cdbe6a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:19.841007 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4b38f0bf-86a3-4552-8137-e73a6cdbe6a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:19.841448 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4b38f0bf-86a3-4552-8137-e73a6cdbe6a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:19.973476 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4b38f0bf-86a3-4552-8137-e73a6cdbe6a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:19.981704 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4b38f0bf-86a3-4552-8137-e73a6cdbe6a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154300 Jul 21 17:50:19.982283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 397/786] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:19 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:20.998822 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-49b2a8c5-2853-426c-bb71-fcadf243d801 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:20.999444 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-49b2a8c5-2853-426c-bb71-fcadf243d801 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:21.006085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49b2a8c5-2853-426c-bb71-fcadf243d801 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:21.006694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49b2a8c5-2853-426c-bb71-fcadf243d801 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:21.007479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49b2a8c5-2853-426c-bb71-fcadf243d801 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:21.007921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49b2a8c5-2853-426c-bb71-fcadf243d801 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:21.136802 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-49b2a8c5-2853-426c-bb71-fcadf243d801 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:21.144904 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-49b2a8c5-2853-426c-bb71-fcadf243d801 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149992 Jul 21 17:50:21.145472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 390/787] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:20 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:22.215298 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e2d6b537-066b-4c84-b38b-a82a2469a388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:22.215848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e2d6b537-066b-4c84-b38b-a82a2469a388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:22.222404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2d6b537-066b-4c84-b38b-a82a2469a388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:22.222856 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2d6b537-066b-4c84-b38b-a82a2469a388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:22.223619 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2d6b537-066b-4c84-b38b-a82a2469a388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:22.224059 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2d6b537-066b-4c84-b38b-a82a2469a388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:22.228913 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=78 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:50:22.357044 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e2d6b537-066b-4c84-b38b-a82a2469a388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:22.365116 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e2d6b537-066b-4c84-b38b-a82a2469a388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153618 Jul 21 17:50:22.366334 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 398/788] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:22 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:23.382880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c9335400-5c8d-4599-84bb-4130bc5291a0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:23.383500 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c9335400-5c8d-4599-84bb-4130bc5291a0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:23.389993 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9335400-5c8d-4599-84bb-4130bc5291a0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:23.390443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9335400-5c8d-4599-84bb-4130bc5291a0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:23.391213 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9335400-5c8d-4599-84bb-4130bc5291a0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:23.391651 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9335400-5c8d-4599-84bb-4130bc5291a0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:23.519205 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c9335400-5c8d-4599-84bb-4130bc5291a0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:23.528393 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c9335400-5c8d-4599-84bb-4130bc5291a0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149609 Jul 21 17:50:23.528965 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 391/789] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:23 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:24.545669 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-942cdd0e-ced6-4191-bd8c-8e0698a16dd7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:24.546284 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-942cdd0e-ced6-4191-bd8c-8e0698a16dd7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:24.552720 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-942cdd0e-ced6-4191-bd8c-8e0698a16dd7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:24.553842 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-942cdd0e-ced6-4191-bd8c-8e0698a16dd7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:24.554605 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-942cdd0e-ced6-4191-bd8c-8e0698a16dd7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:24.555038 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-942cdd0e-ced6-4191-bd8c-8e0698a16dd7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:24.686245 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-942cdd0e-ced6-4191-bd8c-8e0698a16dd7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:24.694410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-942cdd0e-ced6-4191-bd8c-8e0698a16dd7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152545 Jul 21 17:50:24.694969 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 399/790] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:24 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:25.710744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1068ace3-78f8-4026-a51a-ef522c839288 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:25.711363 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1068ace3-78f8-4026-a51a-ef522c839288 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:25.717965 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1068ace3-78f8-4026-a51a-ef522c839288 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:25.718359 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1068ace3-78f8-4026-a51a-ef522c839288 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:25.719118 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1068ace3-78f8-4026-a51a-ef522c839288 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:25.719555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1068ace3-78f8-4026-a51a-ef522c839288 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:25.849627 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1068ace3-78f8-4026-a51a-ef522c839288 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:25.858030 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1068ace3-78f8-4026-a51a-ef522c839288 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151093 Jul 21 17:50:25.858591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 392/791] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:25 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:26.875739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-211115b1-4535-43d0-b07b-5546f937ad32 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:26.876401 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-211115b1-4535-43d0-b07b-5546f937ad32 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:26.883360 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-211115b1-4535-43d0-b07b-5546f937ad32 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:26.883800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-211115b1-4535-43d0-b07b-5546f937ad32 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:26.884579 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-211115b1-4535-43d0-b07b-5546f937ad32 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:26.885013 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-211115b1-4535-43d0-b07b-5546f937ad32 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:27.016982 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-211115b1-4535-43d0-b07b-5546f937ad32 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:27.025145 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-211115b1-4535-43d0-b07b-5546f937ad32 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153245 Jul 21 17:50:27.025699 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 400/792] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:26 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:28.041911 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5a1f1fb4-8b0c-42ca-85fb-7750e822365c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:28.042544 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5a1f1fb4-8b0c-42ca-85fb-7750e822365c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:28.049487 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a1f1fb4-8b0c-42ca-85fb-7750e822365c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:28.049947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a1f1fb4-8b0c-42ca-85fb-7750e822365c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:28.050722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a1f1fb4-8b0c-42ca-85fb-7750e822365c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:28.051164 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a1f1fb4-8b0c-42ca-85fb-7750e822365c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:28.182528 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5a1f1fb4-8b0c-42ca-85fb-7750e822365c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:28.190846 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5a1f1fb4-8b0c-42ca-85fb-7750e822365c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152657 Jul 21 17:50:28.191627 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 393/793] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:28 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:29.208676 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4353d1d5-6679-4cc3-be43-bde87db1e873 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:29.209715 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4353d1d5-6679-4cc3-be43-bde87db1e873 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:29.216279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4353d1d5-6679-4cc3-be43-bde87db1e873 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:29.216760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4353d1d5-6679-4cc3-be43-bde87db1e873 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:29.217525 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4353d1d5-6679-4cc3-be43-bde87db1e873 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:29.217964 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4353d1d5-6679-4cc3-be43-bde87db1e873 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:29.344975 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4353d1d5-6679-4cc3-be43-bde87db1e873 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:29.353611 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4353d1d5-6679-4cc3-be43-bde87db1e873 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149018 Jul 21 17:50:29.354174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 401/794] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:29 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:30.371270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-54d1c85f-7298-44d4-9dc7-6a88b9848f78 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:30.371888 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-54d1c85f-7298-44d4-9dc7-6a88b9848f78 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:30.378429 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54d1c85f-7298-44d4-9dc7-6a88b9848f78 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:30.378881 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54d1c85f-7298-44d4-9dc7-6a88b9848f78 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:30.379647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54d1c85f-7298-44d4-9dc7-6a88b9848f78 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:30.380087 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54d1c85f-7298-44d4-9dc7-6a88b9848f78 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:30.513637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-54d1c85f-7298-44d4-9dc7-6a88b9848f78 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:30.521791 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-54d1c85f-7298-44d4-9dc7-6a88b9848f78 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154398 Jul 21 17:50:30.522349 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 394/795] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:30 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:31.538494 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b7e118ad-0259-45d8-88eb-846bb675daf8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:31.539104 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b7e118ad-0259-45d8-88eb-846bb675daf8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:31.545430 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b7e118ad-0259-45d8-88eb-846bb675daf8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:31.545880 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b7e118ad-0259-45d8-88eb-846bb675daf8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:31.546673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b7e118ad-0259-45d8-88eb-846bb675daf8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:31.547112 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b7e118ad-0259-45d8-88eb-846bb675daf8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:31.675058 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b7e118ad-0259-45d8-88eb-846bb675daf8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:31.683450 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b7e118ad-0259-45d8-88eb-846bb675daf8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148788 Jul 21 17:50:31.684013 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 402/796] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:31 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:32.700572 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-993bc94b-6e32-4899-85f0-13803b8b8646 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:32.701142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-993bc94b-6e32-4899-85f0-13803b8b8646 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:32.707408 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-993bc94b-6e32-4899-85f0-13803b8b8646 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:32.707855 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-993bc94b-6e32-4899-85f0-13803b8b8646 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:32.708695 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-993bc94b-6e32-4899-85f0-13803b8b8646 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:32.709723 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-993bc94b-6e32-4899-85f0-13803b8b8646 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:32.835742 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-993bc94b-6e32-4899-85f0-13803b8b8646 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:32.844478 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-993bc94b-6e32-4899-85f0-13803b8b8646 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147873 Jul 21 17:50:32.845040 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 395/797] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:32 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:33.860761 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-53b49866-d1a2-4276-b86e-32f0f1b7f204 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:33.861372 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-53b49866-d1a2-4276-b86e-32f0f1b7f204 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:33.868139 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-53b49866-d1a2-4276-b86e-32f0f1b7f204 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:33.868616 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-53b49866-d1a2-4276-b86e-32f0f1b7f204 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:33.869371 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-53b49866-d1a2-4276-b86e-32f0f1b7f204 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:33.869804 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-53b49866-d1a2-4276-b86e-32f0f1b7f204 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:34.002423 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-53b49866-d1a2-4276-b86e-32f0f1b7f204 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:34.011183 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-53b49866-d1a2-4276-b86e-32f0f1b7f204 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154291 Jul 21 17:50:34.011755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 403/798] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:33 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:35.027753 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-10c65da1-bc0c-43ef-9476-49cf50425a71 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:35.028451 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-10c65da1-bc0c-43ef-9476-49cf50425a71 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:35.030810 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=26 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:50:35.036089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10c65da1-bc0c-43ef-9476-49cf50425a71 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:35.036578 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10c65da1-bc0c-43ef-9476-49cf50425a71 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:35.037865 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10c65da1-bc0c-43ef-9476-49cf50425a71 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:35.038302 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10c65da1-bc0c-43ef-9476-49cf50425a71 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:35.166209 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-10c65da1-bc0c-43ef-9476-49cf50425a71 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:35.174144 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-10c65da1-bc0c-43ef-9476-49cf50425a71 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150246 Jul 21 17:50:35.174710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 396/799] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:35 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:36.190950 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3a7a9980-29d9-4145-90a0-5431bbc18544 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:36.191756 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3a7a9980-29d9-4145-90a0-5431bbc18544 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:36.198981 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a7a9980-29d9-4145-90a0-5431bbc18544 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:36.199228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a7a9980-29d9-4145-90a0-5431bbc18544 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:36.199982 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a7a9980-29d9-4145-90a0-5431bbc18544 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:36.200441 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a7a9980-29d9-4145-90a0-5431bbc18544 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:36.334219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3a7a9980-29d9-4145-90a0-5431bbc18544 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:36.342299 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3a7a9980-29d9-4145-90a0-5431bbc18544 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155261 Jul 21 17:50:36.342893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 404/800] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:36 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:37.360111 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-be3dfcac-86b8-4c11-acaa-c29caee5511e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:37.360703 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-be3dfcac-86b8-4c11-acaa-c29caee5511e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:37.367266 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be3dfcac-86b8-4c11-acaa-c29caee5511e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:37.367715 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be3dfcac-86b8-4c11-acaa-c29caee5511e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:37.368508 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be3dfcac-86b8-4c11-acaa-c29caee5511e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:37.368947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be3dfcac-86b8-4c11-acaa-c29caee5511e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:37.371455 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=76 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:50:37.498243 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-be3dfcac-86b8-4c11-acaa-c29caee5511e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:37.506621 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-be3dfcac-86b8-4c11-acaa-c29caee5511e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149832 Jul 21 17:50:37.507279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 397/801] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:37 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:38.523486 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-063d1226-e6ae-4c10-8005-14b5c3d3181f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:38.524207 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-063d1226-e6ae-4c10-8005-14b5c3d3181f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:38.526528 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=26 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:50:38.531669 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-063d1226-e6ae-4c10-8005-14b5c3d3181f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:38.532117 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-063d1226-e6ae-4c10-8005-14b5c3d3181f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:38.532913 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-063d1226-e6ae-4c10-8005-14b5c3d3181f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:38.533344 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-063d1226-e6ae-4c10-8005-14b5c3d3181f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:38.663181 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-063d1226-e6ae-4c10-8005-14b5c3d3181f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:38.671521 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-063d1226-e6ae-4c10-8005-14b5c3d3181f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152550 Jul 21 17:50:38.672096 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 405/802] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:38 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:39.688448 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1c805bc8-585f-48a2-a94b-f1397ca6a5ed tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:39.689068 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1c805bc8-585f-48a2-a94b-f1397ca6a5ed tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:39.695787 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1c805bc8-585f-48a2-a94b-f1397ca6a5ed tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:39.696239 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1c805bc8-585f-48a2-a94b-f1397ca6a5ed tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:39.697035 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1c805bc8-585f-48a2-a94b-f1397ca6a5ed tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:39.697483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1c805bc8-585f-48a2-a94b-f1397ca6a5ed tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:39.826937 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1c805bc8-585f-48a2-a94b-f1397ca6a5ed tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:39.835378 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1c805bc8-585f-48a2-a94b-f1397ca6a5ed tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150810 Jul 21 17:50:39.835944 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 398/803] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:39 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:40.852705 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2c4e3408-f104-4688-b7c1-8ef4b9c511c1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:40.853237 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2c4e3408-f104-4688-b7c1-8ef4b9c511c1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:40.859753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c4e3408-f104-4688-b7c1-8ef4b9c511c1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:40.860204 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c4e3408-f104-4688-b7c1-8ef4b9c511c1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:40.860996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c4e3408-f104-4688-b7c1-8ef4b9c511c1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:40.861436 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c4e3408-f104-4688-b7c1-8ef4b9c511c1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:40.994366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2c4e3408-f104-4688-b7c1-8ef4b9c511c1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:41.002295 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2c4e3408-f104-4688-b7c1-8ef4b9c511c1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154633 Jul 21 17:50:41.002852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 406/804] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:40 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:42.018929 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7c2613b9-2d4d-4200-baef-911a05b42f36 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:42.019545 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7c2613b9-2d4d-4200-baef-911a05b42f36 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:42.026726 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c2613b9-2d4d-4200-baef-911a05b42f36 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:42.027179 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c2613b9-2d4d-4200-baef-911a05b42f36 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:42.027949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c2613b9-2d4d-4200-baef-911a05b42f36 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:42.028421 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c2613b9-2d4d-4200-baef-911a05b42f36 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:42.161805 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7c2613b9-2d4d-4200-baef-911a05b42f36 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:42.170284 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7c2613b9-2d4d-4200-baef-911a05b42f36 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155248 Jul 21 17:50:42.170848 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 399/805] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:42 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:43.187013 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7d6f8f09-49a0-4bf1-95f6-f183edd7c652 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:43.187655 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7d6f8f09-49a0-4bf1-95f6-f183edd7c652 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:43.194592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d6f8f09-49a0-4bf1-95f6-f183edd7c652 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:43.195040 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d6f8f09-49a0-4bf1-95f6-f183edd7c652 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:43.195806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d6f8f09-49a0-4bf1-95f6-f183edd7c652 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:43.196242 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d6f8f09-49a0-4bf1-95f6-f183edd7c652 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:43.324066 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7d6f8f09-49a0-4bf1-95f6-f183edd7c652 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:43.332186 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7d6f8f09-49a0-4bf1-95f6-f183edd7c652 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149021 Jul 21 17:50:43.332782 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 407/806] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:43 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:44.348475 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ec27150f-d3a0-4313-995c-b92b4eb54279 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:44.349095 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ec27150f-d3a0-4313-995c-b92b4eb54279 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:44.356225 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ec27150f-d3a0-4313-995c-b92b4eb54279 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:44.356706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ec27150f-d3a0-4313-995c-b92b4eb54279 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:44.357510 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ec27150f-d3a0-4313-995c-b92b4eb54279 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:44.357951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ec27150f-d3a0-4313-995c-b92b4eb54279 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:44.491925 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ec27150f-d3a0-4313-995c-b92b4eb54279 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:44.499937 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ec27150f-d3a0-4313-995c-b92b4eb54279 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155328 Jul 21 17:50:44.500526 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 400/807] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:44 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:45.517326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3e43b1fc-5861-4159-84c5-406c12c97bfa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:45.517934 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3e43b1fc-5861-4159-84c5-406c12c97bfa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:45.524747 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3e43b1fc-5861-4159-84c5-406c12c97bfa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:45.525230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3e43b1fc-5861-4159-84c5-406c12c97bfa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:45.526092 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3e43b1fc-5861-4159-84c5-406c12c97bfa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:45.526544 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3e43b1fc-5861-4159-84c5-406c12c97bfa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:45.653715 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3e43b1fc-5861-4159-84c5-406c12c97bfa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:45.661607 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3e43b1fc-5861-4159-84c5-406c12c97bfa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148135 Jul 21 17:50:45.662170 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 408/808] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:45 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:46.679079 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1ef61c7f-043a-452c-96ba-561a7f8d814e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:46.679623 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1ef61c7f-043a-452c-96ba-561a7f8d814e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:46.686210 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ef61c7f-043a-452c-96ba-561a7f8d814e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:46.686663 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ef61c7f-043a-452c-96ba-561a7f8d814e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:46.687426 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ef61c7f-043a-452c-96ba-561a7f8d814e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:46.687867 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ef61c7f-043a-452c-96ba-561a7f8d814e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:46.813577 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1ef61c7f-043a-452c-96ba-561a7f8d814e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:46.827906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1ef61c7f-043a-452c-96ba-561a7f8d814e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152826 Jul 21 17:50:46.828527 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 401/809] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:46 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:47.845660 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-69a993c8-0f5d-4fbd-b9e2-9ae6f6fad443 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:47.846224 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-69a993c8-0f5d-4fbd-b9e2-9ae6f6fad443 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:47.853327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-69a993c8-0f5d-4fbd-b9e2-9ae6f6fad443 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:47.853782 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-69a993c8-0f5d-4fbd-b9e2-9ae6f6fad443 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:47.854544 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-69a993c8-0f5d-4fbd-b9e2-9ae6f6fad443 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:47.854982 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-69a993c8-0f5d-4fbd-b9e2-9ae6f6fad443 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:47.985939 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-69a993c8-0f5d-4fbd-b9e2-9ae6f6fad443 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:47.994335 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-69a993c8-0f5d-4fbd-b9e2-9ae6f6fad443 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152571 Jul 21 17:50:47.994988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 409/810] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:47 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:49.011420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8082287c-b52a-4e06-8142-fb65b0febd30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:49.012037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8082287c-b52a-4e06-8142-fb65b0febd30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:49.018465 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8082287c-b52a-4e06-8142-fb65b0febd30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:49.018912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8082287c-b52a-4e06-8142-fb65b0febd30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:49.019664 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8082287c-b52a-4e06-8142-fb65b0febd30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:49.020105 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8082287c-b52a-4e06-8142-fb65b0febd30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:49.150706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8082287c-b52a-4e06-8142-fb65b0febd30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:49.158618 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8082287c-b52a-4e06-8142-fb65b0febd30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151049 Jul 21 17:50:49.159187 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 402/811] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:49 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:50.174931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a3cfa819-93a1-4f8e-b44d-0d68144fdd08 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:50.175538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a3cfa819-93a1-4f8e-b44d-0d68144fdd08 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:50.182140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a3cfa819-93a1-4f8e-b44d-0d68144fdd08 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:50.182604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a3cfa819-93a1-4f8e-b44d-0d68144fdd08 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:50.183338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a3cfa819-93a1-4f8e-b44d-0d68144fdd08 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:50.183771 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a3cfa819-93a1-4f8e-b44d-0d68144fdd08 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:50.311023 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a3cfa819-93a1-4f8e-b44d-0d68144fdd08 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:50.319286 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a3cfa819-93a1-4f8e-b44d-0d68144fdd08 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148168 Jul 21 17:50:50.319863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 410/812] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:50 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:51.336232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-20f5f1c9-1bb1-40cb-9d71-3976ec1a6068 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:51.336906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-20f5f1c9-1bb1-40cb-9d71-3976ec1a6068 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:51.343522 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20f5f1c9-1bb1-40cb-9d71-3976ec1a6068 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:51.343981 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20f5f1c9-1bb1-40cb-9d71-3976ec1a6068 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:51.344778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20f5f1c9-1bb1-40cb-9d71-3976ec1a6068 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:51.345223 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20f5f1c9-1bb1-40cb-9d71-3976ec1a6068 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:51.473898 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-20f5f1c9-1bb1-40cb-9d71-3976ec1a6068 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:51.482483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-20f5f1c9-1bb1-40cb-9d71-3976ec1a6068 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150117 Jul 21 17:50:51.483036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 403/813] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:51 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:52.499954 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ff31ba61-2088-4a16-bf77-a58093f4e98e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:52.500674 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ff31ba61-2088-4a16-bf77-a58093f4e98e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:52.507919 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ff31ba61-2088-4a16-bf77-a58093f4e98e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:52.508392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ff31ba61-2088-4a16-bf77-a58093f4e98e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:52.509157 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ff31ba61-2088-4a16-bf77-a58093f4e98e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:52.509595 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ff31ba61-2088-4a16-bf77-a58093f4e98e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:52.513498 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=78 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:50:52.640007 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ff31ba61-2088-4a16-bf77-a58093f4e98e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:52.648176 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ff31ba61-2088-4a16-bf77-a58093f4e98e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152056 Jul 21 17:50:52.648787 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 411/814] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:52 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:53.665629 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ac455749-fe6f-4b39-8f0a-119d22a5a1f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:53.666247 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ac455749-fe6f-4b39-8f0a-119d22a5a1f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:53.672837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac455749-fe6f-4b39-8f0a-119d22a5a1f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:53.673289 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac455749-fe6f-4b39-8f0a-119d22a5a1f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:53.674056 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac455749-fe6f-4b39-8f0a-119d22a5a1f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:53.674495 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac455749-fe6f-4b39-8f0a-119d22a5a1f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:53.804709 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ac455749-fe6f-4b39-8f0a-119d22a5a1f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:53.812627 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ac455749-fe6f-4b39-8f0a-119d22a5a1f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151371 Jul 21 17:50:53.813190 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 404/815] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:53 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:54.830781 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a888125a-774f-42f9-b2af-d7d5e52fb88b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:54.831461 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a888125a-774f-42f9-b2af-d7d5e52fb88b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:54.838497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a888125a-774f-42f9-b2af-d7d5e52fb88b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:54.838940 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a888125a-774f-42f9-b2af-d7d5e52fb88b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:54.839701 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a888125a-774f-42f9-b2af-d7d5e52fb88b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:54.840134 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a888125a-774f-42f9-b2af-d7d5e52fb88b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:54.967060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a888125a-774f-42f9-b2af-d7d5e52fb88b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:54.974886 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a888125a-774f-42f9-b2af-d7d5e52fb88b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147895 Jul 21 17:50:54.976339 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 412/816] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:54 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:55.992827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7dc2415e-e3a3-43f3-9c75-f1302ac8680e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:55.993486 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7dc2415e-e3a3-43f3-9c75-f1302ac8680e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:55.999969 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7dc2415e-e3a3-43f3-9c75-f1302ac8680e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:56.000451 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7dc2415e-e3a3-43f3-9c75-f1302ac8680e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:56.001212 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7dc2415e-e3a3-43f3-9c75-f1302ac8680e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:56.001644 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7dc2415e-e3a3-43f3-9c75-f1302ac8680e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:56.135940 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7dc2415e-e3a3-43f3-9c75-f1302ac8680e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:56.143769 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7dc2415e-e3a3-43f3-9c75-f1302ac8680e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154942 Jul 21 17:50:56.144340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 405/817] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:55 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:57.160607 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a0c3c2b9-73fe-41a4-9464-823d4ed2080f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:57.161224 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a0c3c2b9-73fe-41a4-9464-823d4ed2080f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:57.168649 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a0c3c2b9-73fe-41a4-9464-823d4ed2080f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:57.169043 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a0c3c2b9-73fe-41a4-9464-823d4ed2080f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:57.169805 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a0c3c2b9-73fe-41a4-9464-823d4ed2080f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:57.170242 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a0c3c2b9-73fe-41a4-9464-823d4ed2080f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:57.301370 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a0c3c2b9-73fe-41a4-9464-823d4ed2080f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:57.309553 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a0c3c2b9-73fe-41a4-9464-823d4ed2080f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152796 Jul 21 17:50:57.310124 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 413/818] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:57 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:58.327017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ad8f8930-1e85-4bad-b7f7-dbb22831d750 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:58.327577 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ad8f8930-1e85-4bad-b7f7-dbb22831d750 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:58.334320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad8f8930-1e85-4bad-b7f7-dbb22831d750 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:58.335030 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad8f8930-1e85-4bad-b7f7-dbb22831d750 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:58.335833 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad8f8930-1e85-4bad-b7f7-dbb22831d750 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:58.336273 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad8f8930-1e85-4bad-b7f7-dbb22831d750 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:58.465230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ad8f8930-1e85-4bad-b7f7-dbb22831d750 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:58.473190 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ad8f8930-1e85-4bad-b7f7-dbb22831d750 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150192 Jul 21 17:50:58.473752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 406/819] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:58 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:50:59.492477 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fb594fed-0413-4b10-830d-33c3e72b6af3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:50:59.493097 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fb594fed-0413-4b10-830d-33c3e72b6af3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:50:59.499679 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb594fed-0413-4b10-830d-33c3e72b6af3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:59.500124 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb594fed-0413-4b10-830d-33c3e72b6af3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:59.500955 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb594fed-0413-4b10-830d-33c3e72b6af3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:50:59.501384 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb594fed-0413-4b10-830d-33c3e72b6af3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:50:59.629598 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-fb594fed-0413-4b10-830d-33c3e72b6af3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:50:59.637758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fb594fed-0413-4b10-830d-33c3e72b6af3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151144 Jul 21 17:50:59.638522 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 414/820] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:50:59 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:00.654766 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f6144503-be01-4b10-bb8e-e8e0c74dd5c2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:00.655458 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f6144503-be01-4b10-bb8e-e8e0c74dd5c2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:00.662125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6144503-be01-4b10-bb8e-e8e0c74dd5c2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:00.662572 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6144503-be01-4b10-bb8e-e8e0c74dd5c2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:00.663391 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6144503-be01-4b10-bb8e-e8e0c74dd5c2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:00.663842 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6144503-be01-4b10-bb8e-e8e0c74dd5c2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:00.791640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f6144503-be01-4b10-bb8e-e8e0c74dd5c2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:00.799504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f6144503-be01-4b10-bb8e-e8e0c74dd5c2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148847 Jul 21 17:51:00.800064 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 407/821] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:00 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:01.816888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f47cfa3c-0c53-4cf0-8c38-cf344941d23b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:01.817506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f47cfa3c-0c53-4cf0-8c38-cf344941d23b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:01.824728 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f47cfa3c-0c53-4cf0-8c38-cf344941d23b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:01.825181 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f47cfa3c-0c53-4cf0-8c38-cf344941d23b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:01.825944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f47cfa3c-0c53-4cf0-8c38-cf344941d23b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:01.826380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f47cfa3c-0c53-4cf0-8c38-cf344941d23b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:01.959428 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f47cfa3c-0c53-4cf0-8c38-cf344941d23b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:01.968114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f47cfa3c-0c53-4cf0-8c38-cf344941d23b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155224 Jul 21 17:51:01.968716 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 415/822] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:01 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:02.985242 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a3bf7c78-e0f3-4d13-82c8-2852a8338ba5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:02.985788 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a3bf7c78-e0f3-4d13-82c8-2852a8338ba5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:02.992253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a3bf7c78-e0f3-4d13-82c8-2852a8338ba5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:02.992739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a3bf7c78-e0f3-4d13-82c8-2852a8338ba5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:02.993541 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a3bf7c78-e0f3-4d13-82c8-2852a8338ba5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:02.993983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a3bf7c78-e0f3-4d13-82c8-2852a8338ba5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:03.123895 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a3bf7c78-e0f3-4d13-82c8-2852a8338ba5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:03.131995 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a3bf7c78-e0f3-4d13-82c8-2852a8338ba5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150584 Jul 21 17:51:03.132729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 408/823] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:02 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:04.149557 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-23f4b1f6-cc3c-43a4-b453-9f82ab43a157 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:04.150175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-23f4b1f6-cc3c-43a4-b453-9f82ab43a157 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:04.156731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-23f4b1f6-cc3c-43a4-b453-9f82ab43a157 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:04.157187 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-23f4b1f6-cc3c-43a4-b453-9f82ab43a157 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:04.157956 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-23f4b1f6-cc3c-43a4-b453-9f82ab43a157 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:04.158424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-23f4b1f6-cc3c-43a4-b453-9f82ab43a157 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:04.291241 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-23f4b1f6-cc3c-43a4-b453-9f82ab43a157 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:04.299300 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-23f4b1f6-cc3c-43a4-b453-9f82ab43a157 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153666 Jul 21 17:51:04.299865 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 416/824] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:04 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:05.317313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-225861c8-9065-4e04-97b8-6dd1373ba89e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:05.317993 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-225861c8-9065-4e04-97b8-6dd1373ba89e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:05.320999 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=26 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:51:05.326714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-225861c8-9065-4e04-97b8-6dd1373ba89e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:05.327172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-225861c8-9065-4e04-97b8-6dd1373ba89e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:05.327952 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-225861c8-9065-4e04-97b8-6dd1373ba89e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:05.328433 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-225861c8-9065-4e04-97b8-6dd1373ba89e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:05.455612 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-225861c8-9065-4e04-97b8-6dd1373ba89e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:05.463664 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-225861c8-9065-4e04-97b8-6dd1373ba89e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150464 Jul 21 17:51:05.464226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 409/825] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:05 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:06.480035 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e8d896a4-2116-4e87-81e7-624cf166c37d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:06.480686 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e8d896a4-2116-4e87-81e7-624cf166c37d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:06.487130 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e8d896a4-2116-4e87-81e7-624cf166c37d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:06.487577 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e8d896a4-2116-4e87-81e7-624cf166c37d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:06.488366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e8d896a4-2116-4e87-81e7-624cf166c37d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:06.488800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e8d896a4-2116-4e87-81e7-624cf166c37d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:06.620915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e8d896a4-2116-4e87-81e7-624cf166c37d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:06.628904 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e8d896a4-2116-4e87-81e7-624cf166c37d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152871 Jul 21 17:51:06.629470 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 417/826] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:06 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:07.646520 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6c1e3c09-ab1a-4d12-83ce-91227b117faa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:07.647698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6c1e3c09-ab1a-4d12-83ce-91227b117faa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:07.654685 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c1e3c09-ab1a-4d12-83ce-91227b117faa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:07.655134 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c1e3c09-ab1a-4d12-83ce-91227b117faa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:07.655895 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c1e3c09-ab1a-4d12-83ce-91227b117faa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:07.656353 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c1e3c09-ab1a-4d12-83ce-91227b117faa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:07.658850 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=78 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:51:07.786740 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6c1e3c09-ab1a-4d12-83ce-91227b117faa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:07.794688 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6c1e3c09-ab1a-4d12-83ce-91227b117faa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152062 Jul 21 17:51:07.795254 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 410/827] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:07 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:08.812180 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-df714a3e-56fe-4b95-837b-e8c29e7596fa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:08.812794 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-df714a3e-56fe-4b95-837b-e8c29e7596fa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:08.815167 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=26 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:51:08.820963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df714a3e-56fe-4b95-837b-e8c29e7596fa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:08.821421 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df714a3e-56fe-4b95-837b-e8c29e7596fa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:08.822253 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df714a3e-56fe-4b95-837b-e8c29e7596fa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:08.822739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df714a3e-56fe-4b95-837b-e8c29e7596fa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:08.953376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-df714a3e-56fe-4b95-837b-e8c29e7596fa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:08.961541 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-df714a3e-56fe-4b95-837b-e8c29e7596fa tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153271 Jul 21 17:51:08.962097 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 418/828] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:08 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:51:09.979184 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-514f5381-5121-4fb1-bcbe-539e5397bd00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:09.979833 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-514f5381-5121-4fb1-bcbe-539e5397bd00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:09.986427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-514f5381-5121-4fb1-bcbe-539e5397bd00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:09.986877 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-514f5381-5121-4fb1-bcbe-539e5397bd00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:09.987646 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-514f5381-5121-4fb1-bcbe-539e5397bd00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:09.988085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-514f5381-5121-4fb1-bcbe-539e5397bd00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:10.123446 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-514f5381-5121-4fb1-bcbe-539e5397bd00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:10.132152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-514f5381-5121-4fb1-bcbe-539e5397bd00 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156944 Jul 21 17:51:10.132715 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 411/829] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:09 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:11.148476 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1c6b4e0e-3351-4c78-b2d6-2185e40193d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:11.149147 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1c6b4e0e-3351-4c78-b2d6-2185e40193d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:11.155852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1c6b4e0e-3351-4c78-b2d6-2185e40193d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:11.156311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1c6b4e0e-3351-4c78-b2d6-2185e40193d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:11.157160 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1c6b4e0e-3351-4c78-b2d6-2185e40193d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:11.157594 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1c6b4e0e-3351-4c78-b2d6-2185e40193d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:11.286923 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1c6b4e0e-3351-4c78-b2d6-2185e40193d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:11.295002 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1c6b4e0e-3351-4c78-b2d6-2185e40193d0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150669 Jul 21 17:51:11.295580 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 419/830] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:11 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:12.312456 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-384fdab3-be43-41e8-95d2-b7248c4e4db1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:12.313109 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-384fdab3-be43-41e8-95d2-b7248c4e4db1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:12.319679 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-384fdab3-be43-41e8-95d2-b7248c4e4db1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:12.320131 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-384fdab3-be43-41e8-95d2-b7248c4e4db1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:12.321057 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-384fdab3-be43-41e8-95d2-b7248c4e4db1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:12.321503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-384fdab3-be43-41e8-95d2-b7248c4e4db1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:12.449845 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-384fdab3-be43-41e8-95d2-b7248c4e4db1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:12.457785 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-384fdab3-be43-41e8-95d2-b7248c4e4db1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149134 Jul 21 17:51:12.458400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 412/831] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:12 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:13.474684 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7c3189b6-8707-4fbe-ac21-f78ef07f4cfb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:13.475442 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7c3189b6-8707-4fbe-ac21-f78ef07f4cfb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:13.481688 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7c3189b6-8707-4fbe-ac21-f78ef07f4cfb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:13.482132 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7c3189b6-8707-4fbe-ac21-f78ef07f4cfb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:13.482886 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7c3189b6-8707-4fbe-ac21-f78ef07f4cfb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:13.483325 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7c3189b6-8707-4fbe-ac21-f78ef07f4cfb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:13.610542 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7c3189b6-8707-4fbe-ac21-f78ef07f4cfb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:13.619098 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7c3189b6-8707-4fbe-ac21-f78ef07f4cfb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148188 Jul 21 17:51:13.619664 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 420/832] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:13 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:51:14.636717 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-03f8dc5b-b878-4c21-92db-5fa6db633f4c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:14.637338 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-03f8dc5b-b878-4c21-92db-5fa6db633f4c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:14.643766 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-03f8dc5b-b878-4c21-92db-5fa6db633f4c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:14.644220 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-03f8dc5b-b878-4c21-92db-5fa6db633f4c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:14.645017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-03f8dc5b-b878-4c21-92db-5fa6db633f4c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:14.645457 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-03f8dc5b-b878-4c21-92db-5fa6db633f4c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:14.774353 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-03f8dc5b-b878-4c21-92db-5fa6db633f4c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:14.782254 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-03f8dc5b-b878-4c21-92db-5fa6db633f4c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149349 Jul 21 17:51:14.782840 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 413/833] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:14 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:15.800540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5cd893f8-341e-46d3-8422-8cce3878e880 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:15.801771 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5cd893f8-341e-46d3-8422-8cce3878e880 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:15.809856 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5cd893f8-341e-46d3-8422-8cce3878e880 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:15.810510 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5cd893f8-341e-46d3-8422-8cce3878e880 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:15.811338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5cd893f8-341e-46d3-8422-8cce3878e880 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:15.811849 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5cd893f8-341e-46d3-8422-8cce3878e880 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:15.946925 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5cd893f8-341e-46d3-8422-8cce3878e880 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:15.954845 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5cd893f8-341e-46d3-8422-8cce3878e880 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.159639 Jul 21 17:51:15.955425 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 421/834] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:15 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:16.971805 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b0a8d3a8-c560-4948-a41a-f5a0988e6a48 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:16.972480 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b0a8d3a8-c560-4948-a41a-f5a0988e6a48 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:16.979532 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0a8d3a8-c560-4948-a41a-f5a0988e6a48 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:16.979986 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0a8d3a8-c560-4948-a41a-f5a0988e6a48 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:16.980798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0a8d3a8-c560-4948-a41a-f5a0988e6a48 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:16.981260 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0a8d3a8-c560-4948-a41a-f5a0988e6a48 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:17.109163 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b0a8d3a8-c560-4948-a41a-f5a0988e6a48 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:17.117743 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b0a8d3a8-c560-4948-a41a-f5a0988e6a48 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149811 Jul 21 17:51:17.118308 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 414/835] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:16 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:18.135520 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-850d9060-1d3d-4cae-a944-8959b2752b6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:18.136067 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-850d9060-1d3d-4cae-a944-8959b2752b6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:18.144085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-850d9060-1d3d-4cae-a944-8959b2752b6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:18.144576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-850d9060-1d3d-4cae-a944-8959b2752b6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:18.145344 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-850d9060-1d3d-4cae-a944-8959b2752b6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:18.145777 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-850d9060-1d3d-4cae-a944-8959b2752b6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:18.283364 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-850d9060-1d3d-4cae-a944-8959b2752b6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:18.294801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-850d9060-1d3d-4cae-a944-8959b2752b6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.163965 Jul 21 17:51:18.295376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 422/836] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:18 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:19.313216 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4be4eedf-847e-4f41-8435-5566bd5e5ed8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:19.313780 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4be4eedf-847e-4f41-8435-5566bd5e5ed8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:19.321274 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4be4eedf-847e-4f41-8435-5566bd5e5ed8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:19.321719 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4be4eedf-847e-4f41-8435-5566bd5e5ed8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:19.322480 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4be4eedf-847e-4f41-8435-5566bd5e5ed8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:19.322914 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4be4eedf-847e-4f41-8435-5566bd5e5ed8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:19.449691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4be4eedf-847e-4f41-8435-5566bd5e5ed8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:19.457512 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4be4eedf-847e-4f41-8435-5566bd5e5ed8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148241 Jul 21 17:51:19.458072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 415/837] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:19 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:20.475521 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5ae071bc-65a5-4c98-9e35-29c85d7ded90 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:20.476289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5ae071bc-65a5-4c98-9e35-29c85d7ded90 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:20.482820 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ae071bc-65a5-4c98-9e35-29c85d7ded90 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:20.483268 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ae071bc-65a5-4c98-9e35-29c85d7ded90 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:20.484027 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ae071bc-65a5-4c98-9e35-29c85d7ded90 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:20.484500 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ae071bc-65a5-4c98-9e35-29c85d7ded90 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:20.615024 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5ae071bc-65a5-4c98-9e35-29c85d7ded90 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:20.623619 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5ae071bc-65a5-4c98-9e35-29c85d7ded90 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152505 Jul 21 17:51:20.624178 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 423/838] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:20 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:21.640617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f7d55a20-fd71-43f2-9489-774c7b6afdb4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:21.641242 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f7d55a20-fd71-43f2-9489-774c7b6afdb4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:21.648222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f7d55a20-fd71-43f2-9489-774c7b6afdb4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:21.648850 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f7d55a20-fd71-43f2-9489-774c7b6afdb4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:21.649970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f7d55a20-fd71-43f2-9489-774c7b6afdb4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:21.650602 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f7d55a20-fd71-43f2-9489-774c7b6afdb4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:21.780719 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f7d55a20-fd71-43f2-9489-774c7b6afdb4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:21.788647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f7d55a20-fd71-43f2-9489-774c7b6afdb4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151902 Jul 21 17:51:21.789252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 416/839] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:21 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:22.805632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2ef9c8cc-cfca-471c-b761-8c9cf4a4184b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:22.806286 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2ef9c8cc-cfca-471c-b761-8c9cf4a4184b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:22.812803 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2ef9c8cc-cfca-471c-b761-8c9cf4a4184b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:22.813245 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2ef9c8cc-cfca-471c-b761-8c9cf4a4184b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:22.814024 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2ef9c8cc-cfca-471c-b761-8c9cf4a4184b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:22.814466 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2ef9c8cc-cfca-471c-b761-8c9cf4a4184b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:22.819221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=78 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:51:22.946136 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2ef9c8cc-cfca-471c-b761-8c9cf4a4184b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:22.954227 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2ef9c8cc-cfca-471c-b761-8c9cf4a4184b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152469 Jul 21 17:51:22.954798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 424/840] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:22 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:23.971728 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6516aca2-e218-4b79-a1e6-d2c2ae26c6f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:23.972426 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6516aca2-e218-4b79-a1e6-d2c2ae26c6f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:23.979658 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6516aca2-e218-4b79-a1e6-d2c2ae26c6f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:23.980104 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6516aca2-e218-4b79-a1e6-d2c2ae26c6f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:23.980886 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6516aca2-e218-4b79-a1e6-d2c2ae26c6f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:23.981321 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6516aca2-e218-4b79-a1e6-d2c2ae26c6f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:24.111007 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6516aca2-e218-4b79-a1e6-d2c2ae26c6f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:24.119203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6516aca2-e218-4b79-a1e6-d2c2ae26c6f5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151230 Jul 21 17:51:24.119791 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 417/841] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:23 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:25.136281 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dc90fc59-9066-47f9-b982-43b826f41774 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:25.136924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dc90fc59-9066-47f9-b982-43b826f41774 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:25.144063 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc90fc59-9066-47f9-b982-43b826f41774 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:25.144554 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc90fc59-9066-47f9-b982-43b826f41774 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:25.145322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc90fc59-9066-47f9-b982-43b826f41774 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:25.145764 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dc90fc59-9066-47f9-b982-43b826f41774 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:25.276478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-dc90fc59-9066-47f9-b982-43b826f41774 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:25.284534 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dc90fc59-9066-47f9-b982-43b826f41774 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152042 Jul 21 17:51:25.285096 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 425/842] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:25 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:26.301539 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-19cefd90-48af-4fbf-9154-6e2c503244f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:26.302152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-19cefd90-48af-4fbf-9154-6e2c503244f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:26.308649 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19cefd90-48af-4fbf-9154-6e2c503244f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:26.309096 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19cefd90-48af-4fbf-9154-6e2c503244f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:26.309852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19cefd90-48af-4fbf-9154-6e2c503244f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:26.310286 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19cefd90-48af-4fbf-9154-6e2c503244f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:26.441921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-19cefd90-48af-4fbf-9154-6e2c503244f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:26.449896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-19cefd90-48af-4fbf-9154-6e2c503244f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152117 Jul 21 17:51:26.450453 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 418/843] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:26 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:27.467550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3879bead-1fb2-4367-9176-2c05d33ffcfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:27.468163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3879bead-1fb2-4367-9176-2c05d33ffcfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:27.475773 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3879bead-1fb2-4367-9176-2c05d33ffcfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:27.476223 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3879bead-1fb2-4367-9176-2c05d33ffcfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:27.477018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3879bead-1fb2-4367-9176-2c05d33ffcfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:27.477465 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3879bead-1fb2-4367-9176-2c05d33ffcfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:27.606686 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3879bead-1fb2-4367-9176-2c05d33ffcfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:27.614603 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3879bead-1fb2-4367-9176-2c05d33ffcfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150894 Jul 21 17:51:27.615786 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 426/844] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:27 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:28.632869 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6d918991-e766-4f24-a7d1-75961bb76f54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:28.633495 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6d918991-e766-4f24-a7d1-75961bb76f54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:28.640079 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6d918991-e766-4f24-a7d1-75961bb76f54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:28.640571 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6d918991-e766-4f24-a7d1-75961bb76f54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:28.641341 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6d918991-e766-4f24-a7d1-75961bb76f54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:28.641816 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6d918991-e766-4f24-a7d1-75961bb76f54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:28.767407 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6d918991-e766-4f24-a7d1-75961bb76f54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:28.776284 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6d918991-e766-4f24-a7d1-75961bb76f54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147433 Jul 21 17:51:28.776880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 419/845] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:28 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:29.793159 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-de1d2fec-a7e5-4477-8c70-1f5718f0259e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:29.793687 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-de1d2fec-a7e5-4477-8c70-1f5718f0259e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:29.800135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-de1d2fec-a7e5-4477-8c70-1f5718f0259e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:29.800615 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-de1d2fec-a7e5-4477-8c70-1f5718f0259e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:29.801366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-de1d2fec-a7e5-4477-8c70-1f5718f0259e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:29.801797 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-de1d2fec-a7e5-4477-8c70-1f5718f0259e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:29.929839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-de1d2fec-a7e5-4477-8c70-1f5718f0259e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:29.937834 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-de1d2fec-a7e5-4477-8c70-1f5718f0259e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148598 Jul 21 17:51:29.938394 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 427/846] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:29 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:30.955165 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5efa3199-16bd-4c57-8c9d-8ed33d1006a3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:30.955803 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5efa3199-16bd-4c57-8c9d-8ed33d1006a3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:30.961946 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5efa3199-16bd-4c57-8c9d-8ed33d1006a3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:30.962394 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5efa3199-16bd-4c57-8c9d-8ed33d1006a3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:30.963154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5efa3199-16bd-4c57-8c9d-8ed33d1006a3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:30.963589 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5efa3199-16bd-4c57-8c9d-8ed33d1006a3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:31.095258 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5efa3199-16bd-4c57-8c9d-8ed33d1006a3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:31.103802 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5efa3199-16bd-4c57-8c9d-8ed33d1006a3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152682 Jul 21 17:51:31.104386 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 420/847] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:30 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:32.121410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-98e7093f-e78a-4694-aad0-776cbbf81201 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:32.122022 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-98e7093f-e78a-4694-aad0-776cbbf81201 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:32.128283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98e7093f-e78a-4694-aad0-776cbbf81201 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:32.128751 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98e7093f-e78a-4694-aad0-776cbbf81201 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:32.129533 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98e7093f-e78a-4694-aad0-776cbbf81201 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:32.129966 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98e7093f-e78a-4694-aad0-776cbbf81201 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:32.262911 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-98e7093f-e78a-4694-aad0-776cbbf81201 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:32.271965 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-98e7093f-e78a-4694-aad0-776cbbf81201 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153800 Jul 21 17:51:32.272574 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 428/848] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:32 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:33.288893 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-90dfdc35-639c-4e94-82e1-41a8c7e8839d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:33.289517 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-90dfdc35-639c-4e94-82e1-41a8c7e8839d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:33.296101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90dfdc35-639c-4e94-82e1-41a8c7e8839d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:33.296473 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90dfdc35-639c-4e94-82e1-41a8c7e8839d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:33.297249 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90dfdc35-639c-4e94-82e1-41a8c7e8839d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:33.297690 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90dfdc35-639c-4e94-82e1-41a8c7e8839d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:33.435351 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-90dfdc35-639c-4e94-82e1-41a8c7e8839d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:33.444427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-90dfdc35-639c-4e94-82e1-41a8c7e8839d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.159293 Jul 21 17:51:33.444986 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 421/849] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:33 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:34.462321 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a707ad56-eb5f-4e45-9f8f-3431bc13f18f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:34.462944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a707ad56-eb5f-4e45-9f8f-3431bc13f18f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:34.469425 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a707ad56-eb5f-4e45-9f8f-3431bc13f18f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:34.469876 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a707ad56-eb5f-4e45-9f8f-3431bc13f18f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:34.470637 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a707ad56-eb5f-4e45-9f8f-3431bc13f18f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:34.471074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a707ad56-eb5f-4e45-9f8f-3431bc13f18f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:34.603348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a707ad56-eb5f-4e45-9f8f-3431bc13f18f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:34.611243 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a707ad56-eb5f-4e45-9f8f-3431bc13f18f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153710 Jul 21 17:51:34.611800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 429/850] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:34 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:35.628183 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-51001623-a870-4f5c-9fc0-2c5f2f03f6e0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:35.628744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-51001623-a870-4f5c-9fc0-2c5f2f03f6e0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:35.631082 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=26 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:51:35.636534 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51001623-a870-4f5c-9fc0-2c5f2f03f6e0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:35.636983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51001623-a870-4f5c-9fc0-2c5f2f03f6e0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:35.637745 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51001623-a870-4f5c-9fc0-2c5f2f03f6e0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:35.638178 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51001623-a870-4f5c-9fc0-2c5f2f03f6e0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:35.770129 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-51001623-a870-4f5c-9fc0-2c5f2f03f6e0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:35.778591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-51001623-a870-4f5c-9fc0-2c5f2f03f6e0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154333 Jul 21 17:51:35.779164 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 422/851] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:35 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:35.840173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jul 21 17:51:36.796211 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8ec0ec3e-7708-4f5f-862e-da31b7ca1d39 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:36.796853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8ec0ec3e-7708-4f5f-862e-da31b7ca1d39 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:36.803863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8ec0ec3e-7708-4f5f-862e-da31b7ca1d39 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:36.804314 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8ec0ec3e-7708-4f5f-862e-da31b7ca1d39 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:36.805123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8ec0ec3e-7708-4f5f-862e-da31b7ca1d39 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:36.805563 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8ec0ec3e-7708-4f5f-862e-da31b7ca1d39 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:36.930633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8ec0ec3e-7708-4f5f-862e-da31b7ca1d39 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:36.939302 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8ec0ec3e-7708-4f5f-862e-da31b7ca1d39 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.146918 Jul 21 17:51:36.939868 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 430/852] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:36 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:37.957240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bbacc13c-b4b8-44e5-8e92-59516b5bc030 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:37.957855 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bbacc13c-b4b8-44e5-8e92-59516b5bc030 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:37.965775 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bbacc13c-b4b8-44e5-8e92-59516b5bc030 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:37.966225 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bbacc13c-b4b8-44e5-8e92-59516b5bc030 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:37.967004 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bbacc13c-b4b8-44e5-8e92-59516b5bc030 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:37.967438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bbacc13c-b4b8-44e5-8e92-59516b5bc030 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:37.970236 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=78 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:51:38.326073 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bbacc13c-b4b8-44e5-8e92-59516b5bc030 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:38.334940 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bbacc13c-b4b8-44e5-8e92-59516b5bc030 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.381684 Jul 21 17:51:38.335508 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 423/853] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:37 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:39.352612 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bf374009-c6be-47c9-ac2a-d7de33ced3f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:39.353228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bf374009-c6be-47c9-ac2a-d7de33ced3f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:39.355574 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=26 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:51:39.361084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bf374009-c6be-47c9-ac2a-d7de33ced3f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:39.361527 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bf374009-c6be-47c9-ac2a-d7de33ced3f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:39.362304 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bf374009-c6be-47c9-ac2a-d7de33ced3f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:39.362732 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bf374009-c6be-47c9-ac2a-d7de33ced3f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:39.493772 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-bf374009-c6be-47c9-ac2a-d7de33ced3f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:39.501667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bf374009-c6be-47c9-ac2a-d7de33ced3f3 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153714 Jul 21 17:51:39.502236 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 431/854] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:39 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:40.519673 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-17b783b5-66d3-45f9-9cca-9522a2dded37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:40.520311 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-17b783b5-66d3-45f9-9cca-9522a2dded37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:40.527596 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17b783b5-66d3-45f9-9cca-9522a2dded37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:40.528043 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17b783b5-66d3-45f9-9cca-9522a2dded37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:40.528840 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17b783b5-66d3-45f9-9cca-9522a2dded37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:40.529276 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17b783b5-66d3-45f9-9cca-9522a2dded37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:40.658450 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-17b783b5-66d3-45f9-9cca-9522a2dded37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:40.667100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-17b783b5-66d3-45f9-9cca-9522a2dded37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151212 Jul 21 17:51:40.667955 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 424/855] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:40 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:41.684060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7fdceba0-2731-4150-b062-d29a1d496d9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:41.684710 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7fdceba0-2731-4150-b062-d29a1d496d9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:41.691389 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fdceba0-2731-4150-b062-d29a1d496d9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:41.691848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fdceba0-2731-4150-b062-d29a1d496d9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:41.692698 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fdceba0-2731-4150-b062-d29a1d496d9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:41.693151 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fdceba0-2731-4150-b062-d29a1d496d9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:41.834394 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7fdceba0-2731-4150-b062-d29a1d496d9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:41.842442 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7fdceba0-2731-4150-b062-d29a1d496d9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.162290 Jul 21 17:51:41.842995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 432/856] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:41 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:42.859956 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0eca53a8-fc83-4d82-b0e1-cc28cb26f45d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:42.860717 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0eca53a8-fc83-4d82-b0e1-cc28cb26f45d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:42.868063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0eca53a8-fc83-4d82-b0e1-cc28cb26f45d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:42.868544 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0eca53a8-fc83-4d82-b0e1-cc28cb26f45d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:42.869320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0eca53a8-fc83-4d82-b0e1-cc28cb26f45d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:42.869759 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0eca53a8-fc83-4d82-b0e1-cc28cb26f45d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:43.008416 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0eca53a8-fc83-4d82-b0e1-cc28cb26f45d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:43.016389 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0eca53a8-fc83-4d82-b0e1-cc28cb26f45d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.160259 Jul 21 17:51:43.016952 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 425/857] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:42 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:43.904068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jul 21 17:51:44.033233 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9c45b074-e005-4c8a-9562-416f5d58a12a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:44.033885 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9c45b074-e005-4c8a-9562-416f5d58a12a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:44.041078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9c45b074-e005-4c8a-9562-416f5d58a12a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:44.041530 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9c45b074-e005-4c8a-9562-416f5d58a12a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:44.042296 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9c45b074-e005-4c8a-9562-416f5d58a12a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:44.042758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9c45b074-e005-4c8a-9562-416f5d58a12a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:44.172130 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9c45b074-e005-4c8a-9562-416f5d58a12a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:44.180395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9c45b074-e005-4c8a-9562-416f5d58a12a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151017 Jul 21 17:51:44.180960 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 433/858] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:44 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:45.197579 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2d12b387-6dcd-42b6-b207-f12d2e4bd0fe tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:45.198193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2d12b387-6dcd-42b6-b207-f12d2e4bd0fe tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:45.204762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d12b387-6dcd-42b6-b207-f12d2e4bd0fe tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:45.205203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d12b387-6dcd-42b6-b207-f12d2e4bd0fe tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:45.205964 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d12b387-6dcd-42b6-b207-f12d2e4bd0fe tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:45.206399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d12b387-6dcd-42b6-b207-f12d2e4bd0fe tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:45.335868 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2d12b387-6dcd-42b6-b207-f12d2e4bd0fe tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:45.343762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2d12b387-6dcd-42b6-b207-f12d2e4bd0fe tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150015 Jul 21 17:51:45.344347 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 426/859] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:45 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:46.361342 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2b171d7a-93cf-4eb0-9bb6-c6ce9b076331 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:46.361958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2b171d7a-93cf-4eb0-9bb6-c6ce9b076331 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:46.368950 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2b171d7a-93cf-4eb0-9bb6-c6ce9b076331 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:46.369400 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2b171d7a-93cf-4eb0-9bb6-c6ce9b076331 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:46.370153 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2b171d7a-93cf-4eb0-9bb6-c6ce9b076331 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:46.370587 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2b171d7a-93cf-4eb0-9bb6-c6ce9b076331 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:46.503539 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2b171d7a-93cf-4eb0-9bb6-c6ce9b076331 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:46.512212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2b171d7a-93cf-4eb0-9bb6-c6ce9b076331 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154774 Jul 21 17:51:46.512809 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 434/860] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:46 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:51:47.529226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0db8dfc8-4eee-490d-9bab-7a98b9ab5add tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:47.529824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0db8dfc8-4eee-490d-9bab-7a98b9ab5add tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:47.536195 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0db8dfc8-4eee-490d-9bab-7a98b9ab5add tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:47.536704 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0db8dfc8-4eee-490d-9bab-7a98b9ab5add tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:47.537462 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0db8dfc8-4eee-490d-9bab-7a98b9ab5add tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:47.537896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0db8dfc8-4eee-490d-9bab-7a98b9ab5add tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:47.665779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0db8dfc8-4eee-490d-9bab-7a98b9ab5add tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:47.673660 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0db8dfc8-4eee-490d-9bab-7a98b9ab5add tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148304 Jul 21 17:51:47.674220 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 427/861] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:47 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:48.034283 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:51:48.034464 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 17:51:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:51:48.069063 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jul 21 17:51:48.689840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-941885a6-ab14-4a7f-8eac-a9a37ffa7006 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:48.690461 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-941885a6-ab14-4a7f-8eac-a9a37ffa7006 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:48.697443 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-941885a6-ab14-4a7f-8eac-a9a37ffa7006 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:48.697898 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-941885a6-ab14-4a7f-8eac-a9a37ffa7006 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:48.698667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-941885a6-ab14-4a7f-8eac-a9a37ffa7006 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:48.699109 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-941885a6-ab14-4a7f-8eac-a9a37ffa7006 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:48.827823 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-941885a6-ab14-4a7f-8eac-a9a37ffa7006 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:48.836497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-941885a6-ab14-4a7f-8eac-a9a37ffa7006 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150529 Jul 21 17:51:48.837061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 435/862] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:48 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:49.854144 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-18b8c9ca-9001-46e0-8338-c2926b99de9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:49.854761 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-18b8c9ca-9001-46e0-8338-c2926b99de9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:49.861523 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18b8c9ca-9001-46e0-8338-c2926b99de9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:49.861983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18b8c9ca-9001-46e0-8338-c2926b99de9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:49.862761 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18b8c9ca-9001-46e0-8338-c2926b99de9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:49.863203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18b8c9ca-9001-46e0-8338-c2926b99de9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:49.989981 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-18b8c9ca-9001-46e0-8338-c2926b99de9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:49.998012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-18b8c9ca-9001-46e0-8338-c2926b99de9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147785 Jul 21 17:51:49.998571 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 428/863] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:49 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:51.015277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dfb3a3ea-2a13-48fc-a4b3-0aa0f8b8376b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:51.015904 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dfb3a3ea-2a13-48fc-a4b3-0aa0f8b8376b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:51.022610 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dfb3a3ea-2a13-48fc-a4b3-0aa0f8b8376b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:51.023067 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dfb3a3ea-2a13-48fc-a4b3-0aa0f8b8376b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:51.023838 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dfb3a3ea-2a13-48fc-a4b3-0aa0f8b8376b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:51.024279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dfb3a3ea-2a13-48fc-a4b3-0aa0f8b8376b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:51.150746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-dfb3a3ea-2a13-48fc-a4b3-0aa0f8b8376b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:51.158615 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dfb3a3ea-2a13-48fc-a4b3-0aa0f8b8376b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147263 Jul 21 17:51:51.159166 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 436/864] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:51 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:52.175705 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b19a1c5b-db91-47a6-931a-861dafa38c27 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:52.176344 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b19a1c5b-db91-47a6-931a-861dafa38c27 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:52.182906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b19a1c5b-db91-47a6-931a-861dafa38c27 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:52.183343 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b19a1c5b-db91-47a6-931a-861dafa38c27 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:52.184115 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b19a1c5b-db91-47a6-931a-861dafa38c27 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:52.184603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b19a1c5b-db91-47a6-931a-861dafa38c27 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:52.320420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b19a1c5b-db91-47a6-931a-861dafa38c27 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:52.328359 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b19a1c5b-db91-47a6-931a-861dafa38c27 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156508 Jul 21 17:51:52.328925 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 429/865] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:52 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:53.346088 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cbd3fd0e-f3a8-4746-a22f-53265083ef6a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:53.346698 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cbd3fd0e-f3a8-4746-a22f-53265083ef6a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:53.354190 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cbd3fd0e-f3a8-4746-a22f-53265083ef6a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:53.354638 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cbd3fd0e-f3a8-4746-a22f-53265083ef6a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:53.355399 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cbd3fd0e-f3a8-4746-a22f-53265083ef6a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:53.356003 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cbd3fd0e-f3a8-4746-a22f-53265083ef6a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:53.360827 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=78 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:51:53.490846 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-cbd3fd0e-f3a8-4746-a22f-53265083ef6a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:53.498852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cbd3fd0e-f3a8-4746-a22f-53265083ef6a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156763 Jul 21 17:51:53.499408 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 437/866] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:53 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:54.516261 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c0db8ddc-6519-4867-ab24-5ba5cec51c22 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:54.516904 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c0db8ddc-6519-4867-ab24-5ba5cec51c22 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:54.523533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c0db8ddc-6519-4867-ab24-5ba5cec51c22 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:54.523963 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c0db8ddc-6519-4867-ab24-5ba5cec51c22 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:54.524751 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c0db8ddc-6519-4867-ab24-5ba5cec51c22 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:54.525185 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c0db8ddc-6519-4867-ab24-5ba5cec51c22 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:54.656906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c0db8ddc-6519-4867-ab24-5ba5cec51c22 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:54.665452 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c0db8ddc-6519-4867-ab24-5ba5cec51c22 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153019 Jul 21 17:51:54.666008 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 430/867] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:54 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:55.682335 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b90284e7-50e0-49fd-a9d6-45a0025e6494 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:55.682960 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b90284e7-50e0-49fd-a9d6-45a0025e6494 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:55.689519 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b90284e7-50e0-49fd-a9d6-45a0025e6494 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:55.689967 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b90284e7-50e0-49fd-a9d6-45a0025e6494 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:55.690720 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b90284e7-50e0-49fd-a9d6-45a0025e6494 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:55.691410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b90284e7-50e0-49fd-a9d6-45a0025e6494 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:55.817155 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b90284e7-50e0-49fd-a9d6-45a0025e6494 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:55.826249 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b90284e7-50e0-49fd-a9d6-45a0025e6494 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147022 Jul 21 17:51:55.826737 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 438/868] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:55 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:56.843215 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d7367878-2591-4beb-8551-6d92806e580c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:56.843837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d7367878-2591-4beb-8551-6d92806e580c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:56.850823 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d7367878-2591-4beb-8551-6d92806e580c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:56.851276 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d7367878-2591-4beb-8551-6d92806e580c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:56.852058 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d7367878-2591-4beb-8551-6d92806e580c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:56.852523 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d7367878-2591-4beb-8551-6d92806e580c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:56.986943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d7367878-2591-4beb-8551-6d92806e580c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:56.995932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d7367878-2591-4beb-8551-6d92806e580c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156563 Jul 21 17:51:56.996734 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 431/869] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:56 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:51:58.012581 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7009799c-e42f-4da2-97ac-7e6ec6e6b59e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:58.013202 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7009799c-e42f-4da2-97ac-7e6ec6e6b59e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:58.019642 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7009799c-e42f-4da2-97ac-7e6ec6e6b59e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:58.020089 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7009799c-e42f-4da2-97ac-7e6ec6e6b59e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:58.021525 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7009799c-e42f-4da2-97ac-7e6ec6e6b59e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:58.021966 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7009799c-e42f-4da2-97ac-7e6ec6e6b59e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:58.150101 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7009799c-e42f-4da2-97ac-7e6ec6e6b59e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:58.158147 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7009799c-e42f-4da2-97ac-7e6ec6e6b59e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149424 Jul 21 17:51:58.158725 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 439/870] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:58 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:51:59.175927 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-778a2241-fbe3-4df8-90f4-74a2806b8ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:51:59.177034 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-778a2241-fbe3-4df8-90f4-74a2806b8ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:51:59.183894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-778a2241-fbe3-4df8-90f4-74a2806b8ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:59.184369 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-778a2241-fbe3-4df8-90f4-74a2806b8ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:59.185134 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-778a2241-fbe3-4df8-90f4-74a2806b8ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:51:59.185571 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-778a2241-fbe3-4df8-90f4-74a2806b8ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:51:59.314130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-778a2241-fbe3-4df8-90f4-74a2806b8ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:51:59.322373 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-778a2241-fbe3-4df8-90f4-74a2806b8ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150302 Jul 21 17:51:59.322936 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 432/871] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:51:59 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:00.339421 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f0409a92-6dc8-4d9d-be73-dd09cd77aad9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:00.339956 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f0409a92-6dc8-4d9d-be73-dd09cd77aad9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:00.346486 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f0409a92-6dc8-4d9d-be73-dd09cd77aad9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:00.346933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f0409a92-6dc8-4d9d-be73-dd09cd77aad9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:00.347696 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f0409a92-6dc8-4d9d-be73-dd09cd77aad9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:00.348134 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f0409a92-6dc8-4d9d-be73-dd09cd77aad9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:00.481859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f0409a92-6dc8-4d9d-be73-dd09cd77aad9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:00.490993 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f0409a92-6dc8-4d9d-be73-dd09cd77aad9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155487 Jul 21 17:52:00.491563 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 440/872] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:00 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:01.508143 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9e43302a-6228-4e2d-a649-4537df435307 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:01.508782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9e43302a-6228-4e2d-a649-4537df435307 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:01.514923 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9e43302a-6228-4e2d-a649-4537df435307 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:01.515365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9e43302a-6228-4e2d-a649-4537df435307 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:01.516136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9e43302a-6228-4e2d-a649-4537df435307 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:01.516581 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9e43302a-6228-4e2d-a649-4537df435307 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:01.563061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:52:01.563640 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 17:52:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:52:01.646967 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9e43302a-6228-4e2d-a649-4537df435307 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:01.654874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9e43302a-6228-4e2d-a649-4537df435307 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151171 Jul 21 17:52:01.655431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 433/873] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:01 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:02.671748 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0f32172a-d1a7-44ef-b6e6-7cfa4e1bdbe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:02.672396 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0f32172a-d1a7-44ef-b6e6-7cfa4e1bdbe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:02.678713 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0f32172a-d1a7-44ef-b6e6-7cfa4e1bdbe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:02.679170 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0f32172a-d1a7-44ef-b6e6-7cfa4e1bdbe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:02.679940 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0f32172a-d1a7-44ef-b6e6-7cfa4e1bdbe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:02.680418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0f32172a-d1a7-44ef-b6e6-7cfa4e1bdbe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:02.811843 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0f32172a-d1a7-44ef-b6e6-7cfa4e1bdbe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:02.820634 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0f32172a-d1a7-44ef-b6e6-7cfa4e1bdbe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152748 Jul 21 17:52:02.821201 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 441/874] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:02 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:03.838039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6a37f875-9bd0-446e-8d7b-76e47ff381d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:03.838662 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6a37f875-9bd0-446e-8d7b-76e47ff381d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:03.845249 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6a37f875-9bd0-446e-8d7b-76e47ff381d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:03.845704 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6a37f875-9bd0-446e-8d7b-76e47ff381d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:03.846472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6a37f875-9bd0-446e-8d7b-76e47ff381d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:03.846910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6a37f875-9bd0-446e-8d7b-76e47ff381d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:03.983137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6a37f875-9bd0-446e-8d7b-76e47ff381d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:03.991465 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6a37f875-9bd0-446e-8d7b-76e47ff381d8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.157140 Jul 21 17:52:03.991956 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 434/875] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:03 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:05.009030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2eaac5f6-d6ef-4108-9302-d8e80abd89b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:05.009657 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2eaac5f6-d6ef-4108-9302-d8e80abd89b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:05.015597 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2eaac5f6-d6ef-4108-9302-d8e80abd89b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:05.016046 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2eaac5f6-d6ef-4108-9302-d8e80abd89b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:05.016848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2eaac5f6-d6ef-4108-9302-d8e80abd89b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:05.017283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2eaac5f6-d6ef-4108-9302-d8e80abd89b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:05.143845 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2eaac5f6-d6ef-4108-9302-d8e80abd89b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:05.152275 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2eaac5f6-d6ef-4108-9302-d8e80abd89b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147732 Jul 21 17:52:05.152852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 442/876] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:05 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:06.169954 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dbb8878a-a4da-4338-87b9-4353f0f4ee0f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:06.170501 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dbb8878a-a4da-4338-87b9-4353f0f4ee0f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:06.172881 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=26 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:52:06.179218 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dbb8878a-a4da-4338-87b9-4353f0f4ee0f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:06.179675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dbb8878a-a4da-4338-87b9-4353f0f4ee0f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:06.180479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dbb8878a-a4da-4338-87b9-4353f0f4ee0f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:06.180925 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dbb8878a-a4da-4338-87b9-4353f0f4ee0f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:06.314204 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dbb8878a-a4da-4338-87b9-4353f0f4ee0f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:06.323153 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dbb8878a-a4da-4338-87b9-4353f0f4ee0f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156994 Jul 21 17:52:06.323728 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 435/877] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:06 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:07.051545 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 21 17:52:07.051969 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 17:52:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:52:07.340219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-92ea0c90-4508-4651-8728-3f6253200fe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:07.340791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-92ea0c90-4508-4651-8728-3f6253200fe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:07.347293 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92ea0c90-4508-4651-8728-3f6253200fe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:07.347748 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92ea0c90-4508-4651-8728-3f6253200fe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:07.349147 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92ea0c90-4508-4651-8728-3f6253200fe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:07.349619 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92ea0c90-4508-4651-8728-3f6253200fe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:07.477883 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-92ea0c90-4508-4651-8728-3f6253200fe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:07.485847 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-92ea0c90-4508-4651-8728-3f6253200fe5 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149521 Jul 21 17:52:07.486685 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 443/878] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:07 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:08.504210 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4d1a9e31-cd8a-4d3c-b8d9-fe5173605a31 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:08.505082 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4d1a9e31-cd8a-4d3c-b8d9-fe5173605a31 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:08.511678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d1a9e31-cd8a-4d3c-b8d9-fe5173605a31 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:08.512169 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d1a9e31-cd8a-4d3c-b8d9-fe5173605a31 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:08.512990 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d1a9e31-cd8a-4d3c-b8d9-fe5173605a31 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:08.513438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d1a9e31-cd8a-4d3c-b8d9-fe5173605a31 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:08.516465 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=78 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:52:08.645925 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4d1a9e31-cd8a-4d3c-b8d9-fe5173605a31 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:08.653866 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4d1a9e31-cd8a-4d3c-b8d9-fe5173605a31 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153488 Jul 21 17:52:08.654418 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 436/879] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:08 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:09.671755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-22af0a36-7fa6-4b32-9033-0071e44fbe58 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:09.672277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-22af0a36-7fa6-4b32-9033-0071e44fbe58 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:09.674585 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=26 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:52:09.681406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-22af0a36-7fa6-4b32-9033-0071e44fbe58 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:09.681858 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-22af0a36-7fa6-4b32-9033-0071e44fbe58 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:09.682623 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-22af0a36-7fa6-4b32-9033-0071e44fbe58 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:09.683056 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-22af0a36-7fa6-4b32-9033-0071e44fbe58 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:09.812334 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-22af0a36-7fa6-4b32-9033-0071e44fbe58 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:09.821222 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-22af0a36-7fa6-4b32-9033-0071e44fbe58 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153756 Jul 21 17:52:09.821902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 444/880] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:09 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:10.839296 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fce70e7b-19b2-42b3-a9b1-46a79e132538 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:10.840048 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fce70e7b-19b2-42b3-a9b1-46a79e132538 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:10.846640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fce70e7b-19b2-42b3-a9b1-46a79e132538 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:10.847092 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fce70e7b-19b2-42b3-a9b1-46a79e132538 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:10.847873 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fce70e7b-19b2-42b3-a9b1-46a79e132538 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:10.848587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fce70e7b-19b2-42b3-a9b1-46a79e132538 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:10.984064 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fce70e7b-19b2-42b3-a9b1-46a79e132538 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:10.992017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fce70e7b-19b2-42b3-a9b1-46a79e132538 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156641 Jul 21 17:52:10.992612 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 437/881] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:10 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:12.008849 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3825eac1-ae5f-4e03-89cd-6b7f1bce66a4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:12.009456 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3825eac1-ae5f-4e03-89cd-6b7f1bce66a4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:12.015974 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3825eac1-ae5f-4e03-89cd-6b7f1bce66a4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:12.016459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3825eac1-ae5f-4e03-89cd-6b7f1bce66a4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:12.017216 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3825eac1-ae5f-4e03-89cd-6b7f1bce66a4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:12.017645 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3825eac1-ae5f-4e03-89cd-6b7f1bce66a4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:12.146104 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3825eac1-ae5f-4e03-89cd-6b7f1bce66a4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:12.153972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3825eac1-ae5f-4e03-89cd-6b7f1bce66a4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148969 Jul 21 17:52:12.154532 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 445/882] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:12 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:13.171723 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-87d5d083-dffa-40bf-bbfc-dcbd134233f6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:13.172362 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-87d5d083-dffa-40bf-bbfc-dcbd134233f6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:13.179640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87d5d083-dffa-40bf-bbfc-dcbd134233f6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:13.180092 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87d5d083-dffa-40bf-bbfc-dcbd134233f6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:13.180889 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87d5d083-dffa-40bf-bbfc-dcbd134233f6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:13.181335 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87d5d083-dffa-40bf-bbfc-dcbd134233f6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:13.311330 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-87d5d083-dffa-40bf-bbfc-dcbd134233f6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:13.320288 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-87d5d083-dffa-40bf-bbfc-dcbd134233f6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152350 Jul 21 17:52:13.320880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 438/883] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:13 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:14.337445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f3c7b352-e62b-457a-8429-f2a0eec4fa81 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:14.337976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f3c7b352-e62b-457a-8429-f2a0eec4fa81 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:14.344655 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f3c7b352-e62b-457a-8429-f2a0eec4fa81 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:14.345106 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f3c7b352-e62b-457a-8429-f2a0eec4fa81 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:14.345878 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f3c7b352-e62b-457a-8429-f2a0eec4fa81 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:14.346315 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f3c7b352-e62b-457a-8429-f2a0eec4fa81 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:14.483555 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f3c7b352-e62b-457a-8429-f2a0eec4fa81 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:14.491643 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f3c7b352-e62b-457a-8429-f2a0eec4fa81 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.158413 Jul 21 17:52:14.492202 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 446/884] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:14 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:15.507999 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9c6b7a8f-59fe-4b14-94c1-cf08bc271071 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:15.508632 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9c6b7a8f-59fe-4b14-94c1-cf08bc271071 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:15.515121 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c6b7a8f-59fe-4b14-94c1-cf08bc271071 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:15.515568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c6b7a8f-59fe-4b14-94c1-cf08bc271071 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:15.516340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c6b7a8f-59fe-4b14-94c1-cf08bc271071 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:15.516776 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c6b7a8f-59fe-4b14-94c1-cf08bc271071 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:15.645108 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9c6b7a8f-59fe-4b14-94c1-cf08bc271071 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:15.653002 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9c6b7a8f-59fe-4b14-94c1-cf08bc271071 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149355 Jul 21 17:52:15.653570 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 439/885] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:15 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:16.669791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-69ac5e14-9fe4-4234-af05-d3f7a674d870 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:16.670405 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-69ac5e14-9fe4-4234-af05-d3f7a674d870 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:16.676924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-69ac5e14-9fe4-4234-af05-d3f7a674d870 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:16.677371 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-69ac5e14-9fe4-4234-af05-d3f7a674d870 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:16.678127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-69ac5e14-9fe4-4234-af05-d3f7a674d870 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:16.678559 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-69ac5e14-9fe4-4234-af05-d3f7a674d870 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:16.811012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-69ac5e14-9fe4-4234-af05-d3f7a674d870 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:16.821010 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-69ac5e14-9fe4-4234-af05-d3f7a674d870 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155004 Jul 21 17:52:16.821577 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 447/886] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:16 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:17.838830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9ac4b822-52ee-49bd-9526-5c44afaefcf7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:17.839452 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9ac4b822-52ee-49bd-9526-5c44afaefcf7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:17.845982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ac4b822-52ee-49bd-9526-5c44afaefcf7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:17.846434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ac4b822-52ee-49bd-9526-5c44afaefcf7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:17.847191 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ac4b822-52ee-49bd-9526-5c44afaefcf7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:17.847631 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ac4b822-52ee-49bd-9526-5c44afaefcf7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:17.976641 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9ac4b822-52ee-49bd-9526-5c44afaefcf7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:17.984526 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9ac4b822-52ee-49bd-9526-5c44afaefcf7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149423 Jul 21 17:52:17.985109 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 440/887] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:17 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:19.002292 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8e840579-e0e8-4703-8e6e-48e2279f8855 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:19.002908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8e840579-e0e8-4703-8e6e-48e2279f8855 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:19.010140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8e840579-e0e8-4703-8e6e-48e2279f8855 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:19.010586 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8e840579-e0e8-4703-8e6e-48e2279f8855 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:19.011338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8e840579-e0e8-4703-8e6e-48e2279f8855 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:19.011771 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8e840579-e0e8-4703-8e6e-48e2279f8855 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:19.151859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8e840579-e0e8-4703-8e6e-48e2279f8855 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:19.160278 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8e840579-e0e8-4703-8e6e-48e2279f8855 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.161803 Jul 21 17:52:19.160888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 448/888] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:18 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:20.177385 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2e7867d7-16df-43f4-90f0-a6ddcd3f31ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:20.177944 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2e7867d7-16df-43f4-90f0-a6ddcd3f31ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:20.185224 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2e7867d7-16df-43f4-90f0-a6ddcd3f31ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:20.185680 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2e7867d7-16df-43f4-90f0-a6ddcd3f31ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:20.186464 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2e7867d7-16df-43f4-90f0-a6ddcd3f31ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:20.186909 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2e7867d7-16df-43f4-90f0-a6ddcd3f31ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:20.319017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2e7867d7-16df-43f4-90f0-a6ddcd3f31ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:20.327739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2e7867d7-16df-43f4-90f0-a6ddcd3f31ee tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154380 Jul 21 17:52:20.328309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 441/889] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:20 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:21.345157 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fbe8edcc-3a97-4544-a8be-05d3de873a7c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:21.345706 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fbe8edcc-3a97-4544-a8be-05d3de873a7c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:21.352395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fbe8edcc-3a97-4544-a8be-05d3de873a7c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:21.352855 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fbe8edcc-3a97-4544-a8be-05d3de873a7c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:21.353745 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fbe8edcc-3a97-4544-a8be-05d3de873a7c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:21.354307 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fbe8edcc-3a97-4544-a8be-05d3de873a7c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:21.483419 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-fbe8edcc-3a97-4544-a8be-05d3de873a7c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:21.491431 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fbe8edcc-3a97-4544-a8be-05d3de873a7c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150525 Jul 21 17:52:21.491997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 449/890] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:21 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:22.509492 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f2f0831f-93dc-4273-bc7a-715ce4099604 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:22.510102 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f2f0831f-93dc-4273-bc7a-715ce4099604 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:22.516607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2f0831f-93dc-4273-bc7a-715ce4099604 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:22.517054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2f0831f-93dc-4273-bc7a-715ce4099604 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:22.517806 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2f0831f-93dc-4273-bc7a-715ce4099604 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:22.518240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2f0831f-93dc-4273-bc7a-715ce4099604 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:22.651405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f2f0831f-93dc-4273-bc7a-715ce4099604 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:22.659224 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f2f0831f-93dc-4273-bc7a-715ce4099604 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153718 Jul 21 17:52:22.659778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 442/891] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:22 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:23.676356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-398cabcd-851c-4109-82f9-ce3ff6299c74 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:23.676973 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-398cabcd-851c-4109-82f9-ce3ff6299c74 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:23.684386 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-398cabcd-851c-4109-82f9-ce3ff6299c74 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:23.684840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-398cabcd-851c-4109-82f9-ce3ff6299c74 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:23.685599 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-398cabcd-851c-4109-82f9-ce3ff6299c74 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:23.686039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-398cabcd-851c-4109-82f9-ce3ff6299c74 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:23.688579 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=78 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:52:23.815199 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-398cabcd-851c-4109-82f9-ce3ff6299c74 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:23.823867 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-398cabcd-851c-4109-82f9-ce3ff6299c74 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151364 Jul 21 17:52:23.824460 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 450/892] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:23 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:52:24.841275 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f76d87cd-1dd3-4d3f-a192-811669b0e27a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:24.841897 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f76d87cd-1dd3-4d3f-a192-811669b0e27a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:24.848463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f76d87cd-1dd3-4d3f-a192-811669b0e27a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:24.848916 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f76d87cd-1dd3-4d3f-a192-811669b0e27a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:24.849679 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f76d87cd-1dd3-4d3f-a192-811669b0e27a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:24.850117 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f76d87cd-1dd3-4d3f-a192-811669b0e27a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:24.986844 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f76d87cd-1dd3-4d3f-a192-811669b0e27a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:24.995469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f76d87cd-1dd3-4d3f-a192-811669b0e27a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.158067 Jul 21 17:52:24.996032 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 443/893] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:24 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:26.012668 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-93e29a1f-f0e3-4f38-940a-7a9c869200e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:26.013285 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-93e29a1f-f0e3-4f38-940a-7a9c869200e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:26.019554 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93e29a1f-f0e3-4f38-940a-7a9c869200e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:26.020003 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93e29a1f-f0e3-4f38-940a-7a9c869200e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:26.020807 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93e29a1f-f0e3-4f38-940a-7a9c869200e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:26.021247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93e29a1f-f0e3-4f38-940a-7a9c869200e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:26.148175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-93e29a1f-f0e3-4f38-940a-7a9c869200e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:26.155995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-93e29a1f-f0e3-4f38-940a-7a9c869200e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147799 Jul 21 17:52:26.156593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 451/894] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:26 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:27.172666 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a66e4194-0b3e-4a5e-8930-dd42579b0478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:27.173305 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a66e4194-0b3e-4a5e-8930-dd42579b0478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:27.179656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a66e4194-0b3e-4a5e-8930-dd42579b0478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:27.180856 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a66e4194-0b3e-4a5e-8930-dd42579b0478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:27.181629 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a66e4194-0b3e-4a5e-8930-dd42579b0478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:27.182071 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a66e4194-0b3e-4a5e-8930-dd42579b0478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:27.312801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a66e4194-0b3e-4a5e-8930-dd42579b0478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:27.321607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a66e4194-0b3e-4a5e-8930-dd42579b0478 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152692 Jul 21 17:52:27.322170 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 444/895] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:27 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:28.339069 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3463b901-17d2-40e4-965b-1a7102e9e121 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:28.339679 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3463b901-17d2-40e4-965b-1a7102e9e121 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:28.346118 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3463b901-17d2-40e4-965b-1a7102e9e121 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:28.346565 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3463b901-17d2-40e4-965b-1a7102e9e121 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:28.347323 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3463b901-17d2-40e4-965b-1a7102e9e121 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:28.347756 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3463b901-17d2-40e4-965b-1a7102e9e121 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:28.481924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3463b901-17d2-40e4-965b-1a7102e9e121 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:28.489965 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3463b901-17d2-40e4-965b-1a7102e9e121 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155410 Jul 21 17:52:28.490543 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 452/896] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:28 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:29.507201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b96bae05-9463-4559-ac28-5081c8de2084 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:29.507750 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b96bae05-9463-4559-ac28-5081c8de2084 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:29.514373 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b96bae05-9463-4559-ac28-5081c8de2084 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:29.514827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b96bae05-9463-4559-ac28-5081c8de2084 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:29.515601 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b96bae05-9463-4559-ac28-5081c8de2084 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:29.516044 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b96bae05-9463-4559-ac28-5081c8de2084 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:29.645549 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b96bae05-9463-4559-ac28-5081c8de2084 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:29.653622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b96bae05-9463-4559-ac28-5081c8de2084 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150292 Jul 21 17:52:29.654188 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 445/897] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:29 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:30.670826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e1437219-8191-43ac-b2ad-8216f05d3374 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:30.671476 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e1437219-8191-43ac-b2ad-8216f05d3374 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:30.678099 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1437219-8191-43ac-b2ad-8216f05d3374 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:30.678557 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1437219-8191-43ac-b2ad-8216f05d3374 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:30.679324 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1437219-8191-43ac-b2ad-8216f05d3374 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:30.679764 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1437219-8191-43ac-b2ad-8216f05d3374 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:30.815870 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e1437219-8191-43ac-b2ad-8216f05d3374 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:30.824735 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e1437219-8191-43ac-b2ad-8216f05d3374 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.157686 Jul 21 17:52:30.825293 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 453/898] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:30 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:31.843018 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9b710bbe-aab6-4f00-840a-b8ea8745441b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:31.843573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9b710bbe-aab6-4f00-840a-b8ea8745441b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:31.849786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b710bbe-aab6-4f00-840a-b8ea8745441b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:31.850240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b710bbe-aab6-4f00-840a-b8ea8745441b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:31.851004 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b710bbe-aab6-4f00-840a-b8ea8745441b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:31.851447 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b710bbe-aab6-4f00-840a-b8ea8745441b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:31.980012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9b710bbe-aab6-4f00-840a-b8ea8745441b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:31.988035 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9b710bbe-aab6-4f00-840a-b8ea8745441b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148949 Jul 21 17:52:31.988637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 446/899] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:31 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:33.005232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c9120118-1459-4442-a385-3766cf5f400d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:33.005844 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c9120118-1459-4442-a385-3766cf5f400d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:33.012328 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c9120118-1459-4442-a385-3766cf5f400d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:33.012773 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c9120118-1459-4442-a385-3766cf5f400d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:33.013529 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c9120118-1459-4442-a385-3766cf5f400d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:33.013963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c9120118-1459-4442-a385-3766cf5f400d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:33.142324 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c9120118-1459-4442-a385-3766cf5f400d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:33.150916 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c9120118-1459-4442-a385-3766cf5f400d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149635 Jul 21 17:52:33.151482 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 454/900] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:33 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:34.167542 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c40fa16e-997b-43a5-8948-38a2564933a8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:34.168230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c40fa16e-997b-43a5-8948-38a2564933a8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:34.175017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c40fa16e-997b-43a5-8948-38a2564933a8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:34.175472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c40fa16e-997b-43a5-8948-38a2564933a8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:34.176240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c40fa16e-997b-43a5-8948-38a2564933a8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:34.176713 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c40fa16e-997b-43a5-8948-38a2564933a8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:34.311722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c40fa16e-997b-43a5-8948-38a2564933a8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:34.319919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c40fa16e-997b-43a5-8948-38a2564933a8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156921 Jul 21 17:52:34.320568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 447/901] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:34 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:35.337039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2d6f31c0-605d-49ba-b30b-509c4c28f2eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:35.337568 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2d6f31c0-605d-49ba-b30b-509c4c28f2eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:35.343936 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d6f31c0-605d-49ba-b30b-509c4c28f2eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:35.344410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d6f31c0-605d-49ba-b30b-509c4c28f2eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:35.345167 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d6f31c0-605d-49ba-b30b-509c4c28f2eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:35.345595 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d6f31c0-605d-49ba-b30b-509c4c28f2eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:35.475775 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2d6f31c0-605d-49ba-b30b-509c4c28f2eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:35.485326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2d6f31c0-605d-49ba-b30b-509c4c28f2eb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152295 Jul 21 17:52:35.486150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 455/902] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:35 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:36.502955 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6cb0dc4e-7778-4dbd-b2e3-461dc141c7b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:36.503583 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6cb0dc4e-7778-4dbd-b2e3-461dc141c7b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:36.507204 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=26 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:52:36.512559 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6cb0dc4e-7778-4dbd-b2e3-461dc141c7b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:36.513017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6cb0dc4e-7778-4dbd-b2e3-461dc141c7b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:36.513808 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6cb0dc4e-7778-4dbd-b2e3-461dc141c7b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:36.514249 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6cb0dc4e-7778-4dbd-b2e3-461dc141c7b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:36.646607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6cb0dc4e-7778-4dbd-b2e3-461dc141c7b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:36.654931 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6cb0dc4e-7778-4dbd-b2e3-461dc141c7b2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155988 Jul 21 17:52:36.655506 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 448/903] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:36 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:37.670920 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-46d44397-3322-4820-8d25-14828b96982a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:37.671531 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-46d44397-3322-4820-8d25-14828b96982a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:37.678221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-46d44397-3322-4820-8d25-14828b96982a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:37.678670 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-46d44397-3322-4820-8d25-14828b96982a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:37.679424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-46d44397-3322-4820-8d25-14828b96982a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:37.680544 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-46d44397-3322-4820-8d25-14828b96982a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:37.807623 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-46d44397-3322-4820-8d25-14828b96982a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:37.815483 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-46d44397-3322-4820-8d25-14828b96982a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148367 Jul 21 17:52:37.816311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 456/904] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:37 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:38.833012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-de1e230d-c40a-40f9-b2f5-9a94f6ef8d9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:38.833632 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-de1e230d-c40a-40f9-b2f5-9a94f6ef8d9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:38.840681 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de1e230d-c40a-40f9-b2f5-9a94f6ef8d9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:38.841132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de1e230d-c40a-40f9-b2f5-9a94f6ef8d9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:38.841897 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de1e230d-c40a-40f9-b2f5-9a94f6ef8d9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:38.842338 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de1e230d-c40a-40f9-b2f5-9a94f6ef8d9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:38.846194 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=78 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:52:38.975279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-de1e230d-c40a-40f9-b2f5-9a94f6ef8d9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:38.983874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-de1e230d-c40a-40f9-b2f5-9a94f6ef8d9d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154650 Jul 21 17:52:38.984453 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 449/905] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:38 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:40.000677 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5ec59519-0fb2-48c7-babc-82ad4a67007c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:40.001305 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5ec59519-0fb2-48c7-babc-82ad4a67007c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:40.003663 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=26 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:52:40.009061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ec59519-0fb2-48c7-babc-82ad4a67007c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:40.009510 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ec59519-0fb2-48c7-babc-82ad4a67007c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:40.010280 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ec59519-0fb2-48c7-babc-82ad4a67007c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:40.010724 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ec59519-0fb2-48c7-babc-82ad4a67007c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:40.142172 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5ec59519-0fb2-48c7-babc-82ad4a67007c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:40.150175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5ec59519-0fb2-48c7-babc-82ad4a67007c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153441 Jul 21 17:52:40.150740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 457/906] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:39 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:41.167094 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-96bf24a1-e4f1-4994-a91a-c7973a76fe15 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:41.167736 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-96bf24a1-e4f1-4994-a91a-c7973a76fe15 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:41.174295 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-96bf24a1-e4f1-4994-a91a-c7973a76fe15 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:41.174744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-96bf24a1-e4f1-4994-a91a-c7973a76fe15 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:41.175505 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-96bf24a1-e4f1-4994-a91a-c7973a76fe15 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:41.175936 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-96bf24a1-e4f1-4994-a91a-c7973a76fe15 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:41.307999 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-96bf24a1-e4f1-4994-a91a-c7973a76fe15 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:41.315907 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-96bf24a1-e4f1-4994-a91a-c7973a76fe15 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152707 Jul 21 17:52:41.316765 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 450/907] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:41 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:42.333885 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-528f5e0b-cdb1-40a9-8004-f38072da9c30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:42.334422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-528f5e0b-cdb1-40a9-8004-f38072da9c30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:42.341722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-528f5e0b-cdb1-40a9-8004-f38072da9c30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:42.342172 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-528f5e0b-cdb1-40a9-8004-f38072da9c30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:42.342936 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-528f5e0b-cdb1-40a9-8004-f38072da9c30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:42.343371 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-528f5e0b-cdb1-40a9-8004-f38072da9c30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:42.473917 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-528f5e0b-cdb1-40a9-8004-f38072da9c30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:42.481931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-528f5e0b-cdb1-40a9-8004-f38072da9c30 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151989 Jul 21 17:52:42.482491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 458/908] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:42 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:43.498932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2fbaad71-0cae-4759-a422-54b2d4b30794 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:43.499682 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2fbaad71-0cae-4759-a422-54b2d4b30794 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:43.506281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2fbaad71-0cae-4759-a422-54b2d4b30794 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:43.506728 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2fbaad71-0cae-4759-a422-54b2d4b30794 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:43.507538 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2fbaad71-0cae-4759-a422-54b2d4b30794 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:43.507996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2fbaad71-0cae-4759-a422-54b2d4b30794 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:43.634469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2fbaad71-0cae-4759-a422-54b2d4b30794 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:43.642355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2fbaad71-0cae-4759-a422-54b2d4b30794 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147387 Jul 21 17:52:43.642913 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 451/909] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:43 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:44.660382 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3a82aac3-4ac4-4958-9232-986eb6a25628 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:44.660995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3a82aac3-4ac4-4958-9232-986eb6a25628 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:44.668662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a82aac3-4ac4-4958-9232-986eb6a25628 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:44.669116 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a82aac3-4ac4-4958-9232-986eb6a25628 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:44.669919 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a82aac3-4ac4-4958-9232-986eb6a25628 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:44.670357 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a82aac3-4ac4-4958-9232-986eb6a25628 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:44.802931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3a82aac3-4ac4-4958-9232-986eb6a25628 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:44.811083 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3a82aac3-4ac4-4958-9232-986eb6a25628 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154649 Jul 21 17:52:44.811648 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 459/910] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:44 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:45.828495 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-de72463a-f863-4a0a-85b6-828b9ace7d04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:45.829623 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-de72463a-f863-4a0a-85b6-828b9ace7d04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:45.837266 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de72463a-f863-4a0a-85b6-828b9ace7d04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:45.837765 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de72463a-f863-4a0a-85b6-828b9ace7d04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:45.838636 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de72463a-f863-4a0a-85b6-828b9ace7d04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:45.839277 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de72463a-f863-4a0a-85b6-828b9ace7d04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:45.969995 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-de72463a-f863-4a0a-85b6-828b9ace7d04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:45.978948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-de72463a-f863-4a0a-85b6-828b9ace7d04 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154235 Jul 21 17:52:45.979502 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 452/911] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:45 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:46.997368 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6b1ae680-ba53-4097-bf0e-71615d1c0c2d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:46.997991 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6b1ae680-ba53-4097-bf0e-71615d1c0c2d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:47.004524 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6b1ae680-ba53-4097-bf0e-71615d1c0c2d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:47.005117 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6b1ae680-ba53-4097-bf0e-71615d1c0c2d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:47.005753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6b1ae680-ba53-4097-bf0e-71615d1c0c2d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:47.006227 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6b1ae680-ba53-4097-bf0e-71615d1c0c2d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:47.141061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6b1ae680-ba53-4097-bf0e-71615d1c0c2d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:47.149211 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6b1ae680-ba53-4097-bf0e-71615d1c0c2d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.157378 Jul 21 17:52:47.149916 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 460/912] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:46 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:48.166313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6391f49a-a102-4a16-a7c9-b1151b1ee5a7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:48.166935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6391f49a-a102-4a16-a7c9-b1151b1ee5a7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:48.173419 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6391f49a-a102-4a16-a7c9-b1151b1ee5a7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:48.173881 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6391f49a-a102-4a16-a7c9-b1151b1ee5a7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:48.174685 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6391f49a-a102-4a16-a7c9-b1151b1ee5a7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:48.175129 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6391f49a-a102-4a16-a7c9-b1151b1ee5a7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:48.310097 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6391f49a-a102-4a16-a7c9-b1151b1ee5a7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:48.318206 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6391f49a-a102-4a16-a7c9-b1151b1ee5a7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155773 Jul 21 17:52:48.318761 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 453/913] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:48 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:49.335497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7cdb49c1-7702-4676-a8ad-b34462b8e2bc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:49.336109 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7cdb49c1-7702-4676-a8ad-b34462b8e2bc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:49.343374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7cdb49c1-7702-4676-a8ad-b34462b8e2bc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:49.343826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7cdb49c1-7702-4676-a8ad-b34462b8e2bc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:49.344627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7cdb49c1-7702-4676-a8ad-b34462b8e2bc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:49.345067 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7cdb49c1-7702-4676-a8ad-b34462b8e2bc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:49.473158 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7cdb49c1-7702-4676-a8ad-b34462b8e2bc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:49.481721 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7cdb49c1-7702-4676-a8ad-b34462b8e2bc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150030 Jul 21 17:52:49.482291 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 461/914] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:49 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:50.499005 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-534ca738-6385-4098-8d35-a0c39d5c6f9a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:50.499532 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-534ca738-6385-4098-8d35-a0c39d5c6f9a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:50.506011 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-534ca738-6385-4098-8d35-a0c39d5c6f9a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:50.506460 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-534ca738-6385-4098-8d35-a0c39d5c6f9a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:50.507216 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-534ca738-6385-4098-8d35-a0c39d5c6f9a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:50.507648 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-534ca738-6385-4098-8d35-a0c39d5c6f9a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:50.638635 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-534ca738-6385-4098-8d35-a0c39d5c6f9a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:50.646658 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-534ca738-6385-4098-8d35-a0c39d5c6f9a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151621 Jul 21 17:52:50.647216 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 454/915] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:50 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:51.663336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dbd2016e-2aeb-4bfe-aae2-ac82eaf23fca tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:51.663989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dbd2016e-2aeb-4bfe-aae2-ac82eaf23fca tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:51.670560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dbd2016e-2aeb-4bfe-aae2-ac82eaf23fca tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:51.671017 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dbd2016e-2aeb-4bfe-aae2-ac82eaf23fca tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:51.671787 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dbd2016e-2aeb-4bfe-aae2-ac82eaf23fca tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:51.672226 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dbd2016e-2aeb-4bfe-aae2-ac82eaf23fca tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:51.803989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-dbd2016e-2aeb-4bfe-aae2-ac82eaf23fca tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:51.812983 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dbd2016e-2aeb-4bfe-aae2-ac82eaf23fca tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153522 Jul 21 17:52:51.813555 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 462/916] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:51 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:52.831159 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-56059a93-20d4-4790-84f7-d6509553407c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:52.831693 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-56059a93-20d4-4790-84f7-d6509553407c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:52.838401 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-56059a93-20d4-4790-84f7-d6509553407c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:52.838844 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-56059a93-20d4-4790-84f7-d6509553407c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:52.839603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-56059a93-20d4-4790-84f7-d6509553407c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:52.840036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-56059a93-20d4-4790-84f7-d6509553407c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:52.969917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-56059a93-20d4-4790-84f7-d6509553407c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:52.978987 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-56059a93-20d4-4790-84f7-d6509553407c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151708 Jul 21 17:52:52.979555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 455/917] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:52 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:53.996083 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8a324edd-0c18-4c65-b44b-000b005a2215 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:53.996707 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8a324edd-0c18-4c65-b44b-000b005a2215 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:54.003289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8a324edd-0c18-4c65-b44b-000b005a2215 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:54.003736 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8a324edd-0c18-4c65-b44b-000b005a2215 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:54.004515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8a324edd-0c18-4c65-b44b-000b005a2215 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:54.004950 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8a324edd-0c18-4c65-b44b-000b005a2215 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:54.009448 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=78 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:52:54.135099 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8a324edd-0c18-4c65-b44b-000b005a2215 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:54.143044 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8a324edd-0c18-4c65-b44b-000b005a2215 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151401 Jul 21 17:52:54.143612 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 463/918] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:53 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:55.160976 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-75fc58f7-d340-4ff5-8263-15c2f92f45c0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:55.161589 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-75fc58f7-d340-4ff5-8263-15c2f92f45c0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:55.168324 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75fc58f7-d340-4ff5-8263-15c2f92f45c0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:55.168788 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75fc58f7-d340-4ff5-8263-15c2f92f45c0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:55.169555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75fc58f7-d340-4ff5-8263-15c2f92f45c0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:55.169997 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75fc58f7-d340-4ff5-8263-15c2f92f45c0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:55.296976 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-75fc58f7-d340-4ff5-8263-15c2f92f45c0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:55.304922 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-75fc58f7-d340-4ff5-8263-15c2f92f45c0 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147786 Jul 21 17:52:55.306167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 456/919] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:55 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:56.323520 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7e4490d9-96a3-42f6-ab84-8e953e046759 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:56.324051 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7e4490d9-96a3-42f6-ab84-8e953e046759 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:56.330614 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7e4490d9-96a3-42f6-ab84-8e953e046759 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:56.331068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7e4490d9-96a3-42f6-ab84-8e953e046759 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:56.331840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7e4490d9-96a3-42f6-ab84-8e953e046759 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:56.332281 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7e4490d9-96a3-42f6-ab84-8e953e046759 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:56.467589 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7e4490d9-96a3-42f6-ab84-8e953e046759 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:56.475582 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7e4490d9-96a3-42f6-ab84-8e953e046759 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156698 Jul 21 17:52:56.478531 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 464/920] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:56 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:57.494168 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-92a8726b-cb16-4040-8104-842ab493180b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:57.494768 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-92a8726b-cb16-4040-8104-842ab493180b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:57.501368 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92a8726b-cb16-4040-8104-842ab493180b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:57.501817 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92a8726b-cb16-4040-8104-842ab493180b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:57.502581 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92a8726b-cb16-4040-8104-842ab493180b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:57.503019 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92a8726b-cb16-4040-8104-842ab493180b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:57.636121 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-92a8726b-cb16-4040-8104-842ab493180b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:57.645432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-92a8726b-cb16-4040-8104-842ab493180b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155750 Jul 21 17:52:57.646200 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 457/921] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:57 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:58.661678 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8c13b872-6c0f-45cf-91d4-6ee85e8a23bf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:58.662296 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8c13b872-6c0f-45cf-91d4-6ee85e8a23bf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:58.669685 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8c13b872-6c0f-45cf-91d4-6ee85e8a23bf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:58.670212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8c13b872-6c0f-45cf-91d4-6ee85e8a23bf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:58.671068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8c13b872-6c0f-45cf-91d4-6ee85e8a23bf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:58.671746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8c13b872-6c0f-45cf-91d4-6ee85e8a23bf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:58.803950 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8c13b872-6c0f-45cf-91d4-6ee85e8a23bf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:58.812395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8c13b872-6c0f-45cf-91d4-6ee85e8a23bf tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154481 Jul 21 17:52:58.812947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 465/922] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:58 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:52:59.829356 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-df3f6219-93eb-429e-a5a0-47246e604ba2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:52:59.829967 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-df3f6219-93eb-429e-a5a0-47246e604ba2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:52:59.836323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df3f6219-93eb-429e-a5a0-47246e604ba2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:59.836788 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df3f6219-93eb-429e-a5a0-47246e604ba2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:59.837544 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df3f6219-93eb-429e-a5a0-47246e604ba2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:52:59.837975 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df3f6219-93eb-429e-a5a0-47246e604ba2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:52:59.971577 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-df3f6219-93eb-429e-a5a0-47246e604ba2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:52:59.979646 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-df3f6219-93eb-429e-a5a0-47246e604ba2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154097 Jul 21 17:52:59.980202 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 458/923] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:52:59 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:00.996549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d52f7f30-51c9-4efc-9197-aa9c7906d966 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:00.997159 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d52f7f30-51c9-4efc-9197-aa9c7906d966 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:01.003217 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d52f7f30-51c9-4efc-9197-aa9c7906d966 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:01.003663 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d52f7f30-51c9-4efc-9197-aa9c7906d966 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:01.004443 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d52f7f30-51c9-4efc-9197-aa9c7906d966 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:01.004875 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d52f7f30-51c9-4efc-9197-aa9c7906d966 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:01.131380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d52f7f30-51c9-4efc-9197-aa9c7906d966 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:01.139927 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d52f7f30-51c9-4efc-9197-aa9c7906d966 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147676 Jul 21 17:53:01.140511 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 466/924] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:00 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:02.157722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b18dcac5-0c98-46a4-a73a-ef65a6bf1cfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:02.158337 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b18dcac5-0c98-46a4-a73a-ef65a6bf1cfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:02.164425 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b18dcac5-0c98-46a4-a73a-ef65a6bf1cfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:02.165460 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b18dcac5-0c98-46a4-a73a-ef65a6bf1cfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:02.166236 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b18dcac5-0c98-46a4-a73a-ef65a6bf1cfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:02.166678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b18dcac5-0c98-46a4-a73a-ef65a6bf1cfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:02.298382 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b18dcac5-0c98-46a4-a73a-ef65a6bf1cfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:02.307376 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b18dcac5-0c98-46a4-a73a-ef65a6bf1cfc tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153711 Jul 21 17:53:02.307935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 459/925] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:02 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:03.325020 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-98be5ade-8453-49f3-84ed-519f8415168e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:03.325640 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-98be5ade-8453-49f3-84ed-519f8415168e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:03.332153 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98be5ade-8453-49f3-84ed-519f8415168e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:03.332641 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98be5ade-8453-49f3-84ed-519f8415168e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:03.333409 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98be5ade-8453-49f3-84ed-519f8415168e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:03.333852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98be5ade-8453-49f3-84ed-519f8415168e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:03.460226 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-98be5ade-8453-49f3-84ed-519f8415168e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:03.468999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-98be5ade-8453-49f3-84ed-519f8415168e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148370 Jul 21 17:53:03.469567 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 467/926] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:03 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:04.485903 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-637fc5a7-eec4-417a-865a-cd38115c6994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:04.486520 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-637fc5a7-eec4-417a-865a-cd38115c6994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:04.493728 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-637fc5a7-eec4-417a-865a-cd38115c6994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:04.494181 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-637fc5a7-eec4-417a-865a-cd38115c6994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:04.494943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-637fc5a7-eec4-417a-865a-cd38115c6994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:04.495381 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-637fc5a7-eec4-417a-865a-cd38115c6994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:04.624433 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-637fc5a7-eec4-417a-865a-cd38115c6994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:04.632285 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-637fc5a7-eec4-417a-865a-cd38115c6994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150266 Jul 21 17:53:04.632865 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 460/927] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:04 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:05.648222 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6b323e74-ef38-4e4b-8b55-f6f8dd28a3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:05.649523 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6b323e74-ef38-4e4b-8b55-f6f8dd28a3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:05.656031 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6b323e74-ef38-4e4b-8b55-f6f8dd28a3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:05.656517 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6b323e74-ef38-4e4b-8b55-f6f8dd28a3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:05.657281 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6b323e74-ef38-4e4b-8b55-f6f8dd28a3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:05.657713 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6b323e74-ef38-4e4b-8b55-f6f8dd28a3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:05.784065 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6b323e74-ef38-4e4b-8b55-f6f8dd28a3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:05.791977 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6b323e74-ef38-4e4b-8b55-f6f8dd28a3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147572 Jul 21 17:53:05.792569 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 468/928] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:05 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:06.808944 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bb4889c0-ab8f-4792-9f40-b81a2ae9ddcd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:06.809567 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bb4889c0-ab8f-4792-9f40-b81a2ae9ddcd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:06.811923 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=26 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:53:06.817705 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb4889c0-ab8f-4792-9f40-b81a2ae9ddcd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:06.818163 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb4889c0-ab8f-4792-9f40-b81a2ae9ddcd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:06.818950 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb4889c0-ab8f-4792-9f40-b81a2ae9ddcd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:06.819390 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb4889c0-ab8f-4792-9f40-b81a2ae9ddcd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:06.950374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bb4889c0-ab8f-4792-9f40-b81a2ae9ddcd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:06.958449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bb4889c0-ab8f-4792-9f40-b81a2ae9ddcd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153435 Jul 21 17:53:06.959015 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 461/929] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:06 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:07.975341 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-64dae556-dd56-45e9-82da-679991667347 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:07.975955 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-64dae556-dd56-45e9-82da-679991667347 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:07.983314 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-64dae556-dd56-45e9-82da-679991667347 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:07.983763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-64dae556-dd56-45e9-82da-679991667347 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:07.984549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-64dae556-dd56-45e9-82da-679991667347 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:07.984986 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-64dae556-dd56-45e9-82da-679991667347 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:08.115247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-64dae556-dd56-45e9-82da-679991667347 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:08.123466 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-64dae556-dd56-45e9-82da-679991667347 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151992 Jul 21 17:53:08.124185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 469/930] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:07 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:09.140591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-03068a3b-fe4b-4ce3-aeb0-f58448d2d050 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:09.141213 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-03068a3b-fe4b-4ce3-aeb0-f58448d2d050 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:09.147797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-03068a3b-fe4b-4ce3-aeb0-f58448d2d050 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:09.148245 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-03068a3b-fe4b-4ce3-aeb0-f58448d2d050 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:09.149083 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-03068a3b-fe4b-4ce3-aeb0-f58448d2d050 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:09.149828 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-03068a3b-fe4b-4ce3-aeb0-f58448d2d050 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:09.154080 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=78 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:53:09.283504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-03068a3b-fe4b-4ce3-aeb0-f58448d2d050 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:09.291527 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-03068a3b-fe4b-4ce3-aeb0-f58448d2d050 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155004 Jul 21 17:53:09.292089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 462/931] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:09 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:10.308476 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-111d899f-ef5b-4ed2-a257-c9b86c7080b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:10.309088 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-111d899f-ef5b-4ed2-a257-c9b86c7080b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:10.312379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=26 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:53:10.316370 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-111d899f-ef5b-4ed2-a257-c9b86c7080b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:10.316819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-111d899f-ef5b-4ed2-a257-c9b86c7080b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:10.317576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-111d899f-ef5b-4ed2-a257-c9b86c7080b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:10.318008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-111d899f-ef5b-4ed2-a257-c9b86c7080b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:10.582733 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-111d899f-ef5b-4ed2-a257-c9b86c7080b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:10.590727 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-111d899f-ef5b-4ed2-a257-c9b86c7080b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.286142 Jul 21 17:53:10.591291 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 470/932] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:10 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:11.607609 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-35683714-f6da-4277-a608-110a4405e3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:11.608182 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-35683714-f6da-4277-a608-110a4405e3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:11.614439 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35683714-f6da-4277-a608-110a4405e3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:11.614895 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35683714-f6da-4277-a608-110a4405e3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:11.615670 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35683714-f6da-4277-a608-110a4405e3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:11.616109 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35683714-f6da-4277-a608-110a4405e3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:11.744822 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-35683714-f6da-4277-a608-110a4405e3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:11.752739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-35683714-f6da-4277-a608-110a4405e3d2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149077 Jul 21 17:53:11.753302 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 463/933] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:11 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:12.770443 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7fb8f0c2-8bb9-45b7-a865-855ac5ffa7dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:12.771056 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7fb8f0c2-8bb9-45b7-a865-855ac5ffa7dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:12.778848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fb8f0c2-8bb9-45b7-a865-855ac5ffa7dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:12.779249 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fb8f0c2-8bb9-45b7-a865-855ac5ffa7dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:12.780014 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fb8f0c2-8bb9-45b7-a865-855ac5ffa7dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:12.780488 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fb8f0c2-8bb9-45b7-a865-855ac5ffa7dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:12.910294 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7fb8f0c2-8bb9-45b7-a865-855ac5ffa7dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:12.918419 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7fb8f0c2-8bb9-45b7-a865-855ac5ffa7dd tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151787 Jul 21 17:53:12.919002 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 471/934] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:12 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:13.936403 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2620ae26-8877-43a3-8c59-ab1706f2113b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:13.937056 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2620ae26-8877-43a3-8c59-ab1706f2113b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:13.943843 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2620ae26-8877-43a3-8c59-ab1706f2113b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:13.944319 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2620ae26-8877-43a3-8c59-ab1706f2113b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:13.945097 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2620ae26-8877-43a3-8c59-ab1706f2113b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:13.945584 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2620ae26-8877-43a3-8c59-ab1706f2113b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:14.073991 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2620ae26-8877-43a3-8c59-ab1706f2113b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:14.081930 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2620ae26-8877-43a3-8c59-ab1706f2113b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149406 Jul 21 17:53:14.082494 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 464/935] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:13 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:15.100034 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cb6e5cc2-3f04-4404-9732-388cf4f76f3c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:15.100674 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cb6e5cc2-3f04-4404-9732-388cf4f76f3c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:15.107758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb6e5cc2-3f04-4404-9732-388cf4f76f3c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:15.108213 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb6e5cc2-3f04-4404-9732-388cf4f76f3c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:15.109009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb6e5cc2-3f04-4404-9732-388cf4f76f3c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:15.109449 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb6e5cc2-3f04-4404-9732-388cf4f76f3c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:15.238802 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-cb6e5cc2-3f04-4404-9732-388cf4f76f3c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:15.247208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cb6e5cc2-3f04-4404-9732-388cf4f76f3c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151070 Jul 21 17:53:15.247773 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 472/936] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:15 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:16.264839 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6eee07b8-c702-4979-9f51-3ce4e45bf143 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:16.265377 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6eee07b8-c702-4979-9f51-3ce4e45bf143 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:16.271890 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6eee07b8-c702-4979-9f51-3ce4e45bf143 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:16.272367 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6eee07b8-c702-4979-9f51-3ce4e45bf143 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:16.273133 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6eee07b8-c702-4979-9f51-3ce4e45bf143 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:16.274082 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6eee07b8-c702-4979-9f51-3ce4e45bf143 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:16.405022 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6eee07b8-c702-4979-9f51-3ce4e45bf143 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:16.412800 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6eee07b8-c702-4979-9f51-3ce4e45bf143 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151889 Jul 21 17:53:16.413364 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 465/937] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:16 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:17.431666 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-376eaad3-bf5d-48a3-b382-f51ad72f9b11 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:17.432276 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-376eaad3-bf5d-48a3-b382-f51ad72f9b11 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:17.439104 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-376eaad3-bf5d-48a3-b382-f51ad72f9b11 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:17.439551 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-376eaad3-bf5d-48a3-b382-f51ad72f9b11 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:17.440322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-376eaad3-bf5d-48a3-b382-f51ad72f9b11 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:17.440763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-376eaad3-bf5d-48a3-b382-f51ad72f9b11 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:17.570429 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-376eaad3-bf5d-48a3-b382-f51ad72f9b11 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:17.580550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-376eaad3-bf5d-48a3-b382-f51ad72f9b11 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153482 Jul 21 17:53:17.581127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 473/938] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:17 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:18.598138 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6573a80b-c522-4798-96a3-404d07257ef6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:18.598750 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6573a80b-c522-4798-96a3-404d07257ef6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:18.605259 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6573a80b-c522-4798-96a3-404d07257ef6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:18.605705 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6573a80b-c522-4798-96a3-404d07257ef6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:18.606532 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6573a80b-c522-4798-96a3-404d07257ef6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:18.606883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6573a80b-c522-4798-96a3-404d07257ef6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:18.886683 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6573a80b-c522-4798-96a3-404d07257ef6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:18.894596 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6573a80b-c522-4798-96a3-404d07257ef6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.300294 Jul 21 17:53:18.895152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 466/939] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:18 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:19.911036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3957d2ed-3561-4763-aef8-5ab7ea40bb54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:19.911584 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3957d2ed-3561-4763-aef8-5ab7ea40bb54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:19.918884 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3957d2ed-3561-4763-aef8-5ab7ea40bb54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:19.919339 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3957d2ed-3561-4763-aef8-5ab7ea40bb54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:19.920107 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3957d2ed-3561-4763-aef8-5ab7ea40bb54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:19.920575 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3957d2ed-3561-4763-aef8-5ab7ea40bb54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:20.051078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3957d2ed-3561-4763-aef8-5ab7ea40bb54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:20.061674 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3957d2ed-3561-4763-aef8-5ab7ea40bb54 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.154391 Jul 21 17:53:20.062296 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 474/940] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:19 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:21.080487 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a870ca21-2823-475f-b69e-54632631c6b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:21.081053 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a870ca21-2823-475f-b69e-54632631c6b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:21.087550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a870ca21-2823-475f-b69e-54632631c6b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:21.088007 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a870ca21-2823-475f-b69e-54632631c6b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:21.088820 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a870ca21-2823-475f-b69e-54632631c6b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:21.089267 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a870ca21-2823-475f-b69e-54632631c6b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:21.218410 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a870ca21-2823-475f-b69e-54632631c6b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:21.226468 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a870ca21-2823-475f-b69e-54632631c6b4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149975 Jul 21 17:53:21.227567 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 467/941] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:21 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:22.244622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3aeee537-98b0-48a9-be96-b95bd7ce58e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:22.245160 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3aeee537-98b0-48a9-be96-b95bd7ce58e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:22.251731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3aeee537-98b0-48a9-be96-b95bd7ce58e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:22.252183 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3aeee537-98b0-48a9-be96-b95bd7ce58e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:22.252982 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3aeee537-98b0-48a9-be96-b95bd7ce58e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:22.253420 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3aeee537-98b0-48a9-be96-b95bd7ce58e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:22.378531 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3aeee537-98b0-48a9-be96-b95bd7ce58e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:22.387107 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3aeee537-98b0-48a9-be96-b95bd7ce58e2 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147136 Jul 21 17:53:22.387680 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 475/942] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:22 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:23.404147 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-49412940-54a7-422f-9b7b-65addda1bd0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:23.404787 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-49412940-54a7-422f-9b7b-65addda1bd0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:23.411229 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49412940-54a7-422f-9b7b-65addda1bd0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:23.411679 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49412940-54a7-422f-9b7b-65addda1bd0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:23.412542 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49412940-54a7-422f-9b7b-65addda1bd0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:23.412983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49412940-54a7-422f-9b7b-65addda1bd0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:23.536908 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-49412940-54a7-422f-9b7b-65addda1bd0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:23.545234 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-49412940-54a7-422f-9b7b-65addda1bd0b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.145516 Jul 21 17:53:23.545800 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 468/943] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:23 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:24.562127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-047c0f28-3d51-4f01-b3b3-f7f54000bf6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:24.562737 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-047c0f28-3d51-4f01-b3b3-f7f54000bf6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:24.569540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-047c0f28-3d51-4f01-b3b3-f7f54000bf6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:24.569984 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-047c0f28-3d51-4f01-b3b3-f7f54000bf6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:24.570740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-047c0f28-3d51-4f01-b3b3-f7f54000bf6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:24.571179 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-047c0f28-3d51-4f01-b3b3-f7f54000bf6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:24.575238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=78 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:53:24.701795 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-047c0f28-3d51-4f01-b3b3-f7f54000bf6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:24.709925 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-047c0f28-3d51-4f01-b3b3-f7f54000bf6f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151634 Jul 21 17:53:24.710480 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 476/944] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:24 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:25.727270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-42b5e9f3-dd1e-4ef2-90a1-4a66026047da tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:25.728426 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-42b5e9f3-dd1e-4ef2-90a1-4a66026047da tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:25.734855 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42b5e9f3-dd1e-4ef2-90a1-4a66026047da tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:25.735307 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42b5e9f3-dd1e-4ef2-90a1-4a66026047da tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:25.736072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42b5e9f3-dd1e-4ef2-90a1-4a66026047da tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:25.736541 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42b5e9f3-dd1e-4ef2-90a1-4a66026047da tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:25.861848 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-42b5e9f3-dd1e-4ef2-90a1-4a66026047da tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:25.870474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-42b5e9f3-dd1e-4ef2-90a1-4a66026047da tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147066 Jul 21 17:53:25.871032 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 469/945] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:25 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:26.888060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b3a8e199-2576-47d2-ada7-d373ed75944f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:26.888705 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b3a8e199-2576-47d2-ada7-d373ed75944f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:26.895256 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3a8e199-2576-47d2-ada7-d373ed75944f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:26.895699 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3a8e199-2576-47d2-ada7-d373ed75944f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:26.896519 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3a8e199-2576-47d2-ada7-d373ed75944f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:26.896964 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3a8e199-2576-47d2-ada7-d373ed75944f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:27.028048 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b3a8e199-2576-47d2-ada7-d373ed75944f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:27.036754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b3a8e199-2576-47d2-ada7-d373ed75944f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153569 Jul 21 17:53:27.037318 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 477/946] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:26 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:28.053504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dda0e093-b6f1-47b5-a811-5bba3b095b9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:28.054205 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dda0e093-b6f1-47b5-a811-5bba3b095b9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:28.061511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dda0e093-b6f1-47b5-a811-5bba3b095b9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:28.061965 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dda0e093-b6f1-47b5-a811-5bba3b095b9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:28.062746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dda0e093-b6f1-47b5-a811-5bba3b095b9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:28.063191 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dda0e093-b6f1-47b5-a811-5bba3b095b9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:28.197827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dda0e093-b6f1-47b5-a811-5bba3b095b9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:28.205798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dda0e093-b6f1-47b5-a811-5bba3b095b9f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156779 Jul 21 17:53:28.206752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 470/947] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:28 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:29.222697 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5c010e78-67df-4dc8-8f71-e396d9fe8a6b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:29.223340 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5c010e78-67df-4dc8-8f71-e396d9fe8a6b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:29.232746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c010e78-67df-4dc8-8f71-e396d9fe8a6b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:29.232746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c010e78-67df-4dc8-8f71-e396d9fe8a6b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:29.232746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c010e78-67df-4dc8-8f71-e396d9fe8a6b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:29.232746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c010e78-67df-4dc8-8f71-e396d9fe8a6b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:29.366826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5c010e78-67df-4dc8-8f71-e396d9fe8a6b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:29.374707 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5c010e78-67df-4dc8-8f71-e396d9fe8a6b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.155739 Jul 21 17:53:29.375277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 478/948] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:29 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:30.392439 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-208cdcfd-dc91-4af3-bf23-3101ee697ba6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:30.393063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-208cdcfd-dc91-4af3-bf23-3101ee697ba6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:30.399617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-208cdcfd-dc91-4af3-bf23-3101ee697ba6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:30.401035 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-208cdcfd-dc91-4af3-bf23-3101ee697ba6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:30.401617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-208cdcfd-dc91-4af3-bf23-3101ee697ba6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:30.402061 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-208cdcfd-dc91-4af3-bf23-3101ee697ba6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:30.537581 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-208cdcfd-dc91-4af3-bf23-3101ee697ba6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:30.545578 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-208cdcfd-dc91-4af3-bf23-3101ee697ba6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.157053 Jul 21 17:53:30.546140 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 471/949] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:30 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:31.562962 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d0ac1b1f-d53c-4149-be88-4305fcac51a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:31.563532 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d0ac1b1f-d53c-4149-be88-4305fcac51a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:31.569861 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d0ac1b1f-d53c-4149-be88-4305fcac51a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:31.570310 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d0ac1b1f-d53c-4149-be88-4305fcac51a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:31.571074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d0ac1b1f-d53c-4149-be88-4305fcac51a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:31.571516 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d0ac1b1f-d53c-4149-be88-4305fcac51a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:31.698931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d0ac1b1f-d53c-4149-be88-4305fcac51a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:31.706823 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d0ac1b1f-d53c-4149-be88-4305fcac51a1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.147969 Jul 21 17:53:31.707386 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 479/950] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:31 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:53:32.724857 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d6b0ae4d-2ca6-403a-ac75-cdd34735d7e8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:32.725483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d6b0ae4d-2ca6-403a-ac75-cdd34735d7e8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:32.732316 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d6b0ae4d-2ca6-403a-ac75-cdd34735d7e8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:32.732773 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d6b0ae4d-2ca6-403a-ac75-cdd34735d7e8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:32.733536 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d6b0ae4d-2ca6-403a-ac75-cdd34735d7e8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:32.733978 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d6b0ae4d-2ca6-403a-ac75-cdd34735d7e8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:32.862687 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d6b0ae4d-2ca6-403a-ac75-cdd34735d7e8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:32.870809 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d6b0ae4d-2ca6-403a-ac75-cdd34735d7e8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149799 Jul 21 17:53:32.871375 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 472/951] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:32 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:33.887628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f99e77aa-367a-4d53-9574-584b5a424208 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:33.888231 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f99e77aa-367a-4d53-9574-584b5a424208 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:33.894760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f99e77aa-367a-4d53-9574-584b5a424208 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:33.895206 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f99e77aa-367a-4d53-9574-584b5a424208 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:33.895962 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f99e77aa-367a-4d53-9574-584b5a424208 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:33.896421 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f99e77aa-367a-4d53-9574-584b5a424208 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:34.024748 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f99e77aa-367a-4d53-9574-584b5a424208 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:34.032811 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f99e77aa-367a-4d53-9574-584b5a424208 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149035 Jul 21 17:53:34.033372 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 480/952] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:33 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:35.049424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ea8c2b66-a882-4e83-9884-df64507bb550 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:35.050037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ea8c2b66-a882-4e83-9884-df64507bb550 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:35.056597 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ea8c2b66-a882-4e83-9884-df64507bb550 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:35.057054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ea8c2b66-a882-4e83-9884-df64507bb550 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:35.057828 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ea8c2b66-a882-4e83-9884-df64507bb550 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:35.058275 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ea8c2b66-a882-4e83-9884-df64507bb550 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:35.185801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ea8c2b66-a882-4e83-9884-df64507bb550 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:35.193908 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ea8c2b66-a882-4e83-9884-df64507bb550 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148376 Jul 21 17:53:35.194468 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 473/953] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:35 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:36.210798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2e833aad-8a0f-4dee-a402-f2484fd17665 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:36.211442 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2e833aad-8a0f-4dee-a402-f2484fd17665 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:36.218152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e833aad-8a0f-4dee-a402-f2484fd17665 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:36.218597 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e833aad-8a0f-4dee-a402-f2484fd17665 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:36.219359 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e833aad-8a0f-4dee-a402-f2484fd17665 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:36.219796 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e833aad-8a0f-4dee-a402-f2484fd17665 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:36.347553 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2e833aad-8a0f-4dee-a402-f2484fd17665 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:36.356183 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2e833aad-8a0f-4dee-a402-f2484fd17665 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149217 Jul 21 17:53:36.356780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 481/954] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:36 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:37.374085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d032d604-114b-4344-869e-a1384cc59509 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:37.374704 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d032d604-114b-4344-869e-a1384cc59509 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:37.377056 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=26 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:53:37.382348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d032d604-114b-4344-869e-a1384cc59509 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:37.382803 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d032d604-114b-4344-869e-a1384cc59509 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:37.383571 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d032d604-114b-4344-869e-a1384cc59509 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:37.384155 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d032d604-114b-4344-869e-a1384cc59509 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:37.511784 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d032d604-114b-4344-869e-a1384cc59509 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:37.519790 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d032d604-114b-4344-869e-a1384cc59509 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149592 Jul 21 17:53:37.520362 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 474/955] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:37 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:38.536728 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b3165c73-7f86-4054-a87b-425ef0d941a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:38.537285 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b3165c73-7f86-4054-a87b-425ef0d941a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:38.544571 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3165c73-7f86-4054-a87b-425ef0d941a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:38.545028 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3165c73-7f86-4054-a87b-425ef0d941a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:38.545795 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3165c73-7f86-4054-a87b-425ef0d941a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:38.546228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3165c73-7f86-4054-a87b-425ef0d941a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:38.680467 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b3165c73-7f86-4054-a87b-425ef0d941a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:38.689786 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b3165c73-7f86-4054-a87b-425ef0d941a6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156893 Jul 21 17:53:38.690361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 482/956] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:38 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:39.706925 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ebe081fb-5982-436a-8c3f-180e2674f37c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:39.707585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ebe081fb-5982-436a-8c3f-180e2674f37c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:39.714603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebe081fb-5982-436a-8c3f-180e2674f37c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:39.715056 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebe081fb-5982-436a-8c3f-180e2674f37c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:39.715816 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebe081fb-5982-436a-8c3f-180e2674f37c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:39.716256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ebe081fb-5982-436a-8c3f-180e2674f37c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:39.720502 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=78 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:53:39.858247 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ebe081fb-5982-436a-8c3f-180e2674f37c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:39.866291 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ebe081fb-5982-436a-8c3f-180e2674f37c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.163250 Jul 21 17:53:39.866858 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 475/957] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:39 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:40.884590 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7f1ddbd1-1c99-4db0-b964-5ff6483cf608 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:40.885205 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7f1ddbd1-1c99-4db0-b964-5ff6483cf608 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:40.887558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=26 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:53:40.893499 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7f1ddbd1-1c99-4db0-b964-5ff6483cf608 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:40.893946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7f1ddbd1-1c99-4db0-b964-5ff6483cf608 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:40.894697 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7f1ddbd1-1c99-4db0-b964-5ff6483cf608 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:40.895133 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7f1ddbd1-1c99-4db0-b964-5ff6483cf608 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:41.261698 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7f1ddbd1-1c99-4db0-b964-5ff6483cf608 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:41.269705 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7f1ddbd1-1c99-4db0-b964-5ff6483cf608 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.389118 Jul 21 17:53:41.270274 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 483/958] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:40 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:42.287580 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a831984-c6c7-4d8d-9eb1-1fdc627e7406 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:42.288163 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4a831984-c6c7-4d8d-9eb1-1fdc627e7406 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:42.294904 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a831984-c6c7-4d8d-9eb1-1fdc627e7406 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:42.295354 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a831984-c6c7-4d8d-9eb1-1fdc627e7406 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:42.296118 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a831984-c6c7-4d8d-9eb1-1fdc627e7406 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:42.296584 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a831984-c6c7-4d8d-9eb1-1fdc627e7406 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:42.420694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4a831984-c6c7-4d8d-9eb1-1fdc627e7406 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:42.428565 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4a831984-c6c7-4d8d-9eb1-1fdc627e7406 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.144904 Jul 21 17:53:42.429128 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 476/959] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:42 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:43.446515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-daca7438-92ce-4575-98d5-c91f744823d1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:43.447380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-daca7438-92ce-4575-98d5-c91f744823d1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:43.453569 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-daca7438-92ce-4575-98d5-c91f744823d1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:43.454019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-daca7438-92ce-4575-98d5-c91f744823d1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:43.454767 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-daca7438-92ce-4575-98d5-c91f744823d1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:43.455202 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-daca7438-92ce-4575-98d5-c91f744823d1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:43.583635 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-daca7438-92ce-4575-98d5-c91f744823d1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:43.592123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-daca7438-92ce-4575-98d5-c91f744823d1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149778 Jul 21 17:53:43.592721 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 484/960] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:43 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:44.609436 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4e4935b8-186c-4f56-9ae6-4e0e2d87784e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:44.610066 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4e4935b8-186c-4f56-9ae6-4e0e2d87784e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:44.616726 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e4935b8-186c-4f56-9ae6-4e0e2d87784e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:44.617215 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e4935b8-186c-4f56-9ae6-4e0e2d87784e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:44.618014 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e4935b8-186c-4f56-9ae6-4e0e2d87784e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:44.619035 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e4935b8-186c-4f56-9ae6-4e0e2d87784e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:44.746267 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4e4935b8-186c-4f56-9ae6-4e0e2d87784e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:44.754440 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4e4935b8-186c-4f56-9ae6-4e0e2d87784e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148853 Jul 21 17:53:44.755007 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 477/961] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:44 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:45.772189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dcff8eac-90bd-488c-a6fa-9bbfb0252112 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:45.772838 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dcff8eac-90bd-488c-a6fa-9bbfb0252112 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:45.780003 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dcff8eac-90bd-488c-a6fa-9bbfb0252112 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:45.780563 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dcff8eac-90bd-488c-a6fa-9bbfb0252112 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:45.781333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dcff8eac-90bd-488c-a6fa-9bbfb0252112 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:45.781772 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dcff8eac-90bd-488c-a6fa-9bbfb0252112 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:45.913256 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-dcff8eac-90bd-488c-a6fa-9bbfb0252112 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:45.921566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dcff8eac-90bd-488c-a6fa-9bbfb0252112 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153252 Jul 21 17:53:45.922161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 485/962] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:45 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:46.938265 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6b99decb-f4c7-478a-9126-83d3c8a7d841 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:46.938889 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6b99decb-f4c7-478a-9126-83d3c8a7d841 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:46.945644 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b99decb-f4c7-478a-9126-83d3c8a7d841 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:46.946696 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b99decb-f4c7-478a-9126-83d3c8a7d841 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:46.947469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b99decb-f4c7-478a-9126-83d3c8a7d841 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:46.947898 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b99decb-f4c7-478a-9126-83d3c8a7d841 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:47.083752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6b99decb-f4c7-478a-9126-83d3c8a7d841 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:47.091109 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6b99decb-f4c7-478a-9126-83d3c8a7d841 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.156770 Jul 21 17:53:47.091909 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 478/963] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:46 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:48.108158 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6557ee1a-4788-4fb2-a741-defee804a90d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:48.108858 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6557ee1a-4788-4fb2-a741-defee804a90d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:48.115335 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6557ee1a-4788-4fb2-a741-defee804a90d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:48.115795 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6557ee1a-4788-4fb2-a741-defee804a90d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:48.116594 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6557ee1a-4788-4fb2-a741-defee804a90d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:48.117047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6557ee1a-4788-4fb2-a741-defee804a90d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:48.247410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6557ee1a-4788-4fb2-a741-defee804a90d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:48.255315 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6557ee1a-4788-4fb2-a741-defee804a90d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151097 Jul 21 17:53:48.255878 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 486/964] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:48 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:49.273111 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d17b8231-632c-41fe-af07-437af056418f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:49.273734 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d17b8231-632c-41fe-af07-437af056418f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:49.280927 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d17b8231-632c-41fe-af07-437af056418f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:49.281382 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d17b8231-632c-41fe-af07-437af056418f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:49.282149 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d17b8231-632c-41fe-af07-437af056418f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:49.282620 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d17b8231-632c-41fe-af07-437af056418f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:49.455416 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d17b8231-632c-41fe-af07-437af056418f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:49.463924 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d17b8231-632c-41fe-af07-437af056418f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.194643 Jul 21 17:53:49.464527 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 479/965] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:49 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:50.481471 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-91b2c531-2974-481e-ac5c-a446e3f285db tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:50.482005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-91b2c531-2974-481e-ac5c-a446e3f285db tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:50.488465 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-91b2c531-2974-481e-ac5c-a446e3f285db tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:50.488910 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-91b2c531-2974-481e-ac5c-a446e3f285db tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:50.489658 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-91b2c531-2974-481e-ac5c-a446e3f285db tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:50.490089 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-91b2c531-2974-481e-ac5c-a446e3f285db tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:50.617085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-91b2c531-2974-481e-ac5c-a446e3f285db tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:50.626052 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-91b2c531-2974-481e-ac5c-a446e3f285db tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148965 Jul 21 17:53:50.626622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 487/966] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:50 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:51.644959 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-675e32cc-cbe1-4585-81c3-26d2e3374636 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:51.645581 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-675e32cc-cbe1-4585-81c3-26d2e3374636 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:51.653127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-675e32cc-cbe1-4585-81c3-26d2e3374636 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:51.653579 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-675e32cc-cbe1-4585-81c3-26d2e3374636 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:51.654359 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-675e32cc-cbe1-4585-81c3-26d2e3374636 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:51.654794 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-675e32cc-cbe1-4585-81c3-26d2e3374636 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:51.782644 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-675e32cc-cbe1-4585-81c3-26d2e3374636 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:51.790507 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-675e32cc-cbe1-4585-81c3-26d2e3374636 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149455 Jul 21 17:53:51.791557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 480/967] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:51 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:52.808655 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-99984723-7feb-4c84-bdf0-70a8d2145142 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:52.809210 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-99984723-7feb-4c84-bdf0-70a8d2145142 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:52.816043 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-99984723-7feb-4c84-bdf0-70a8d2145142 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:52.816531 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-99984723-7feb-4c84-bdf0-70a8d2145142 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:52.817295 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-99984723-7feb-4c84-bdf0-70a8d2145142 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:52.817731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-99984723-7feb-4c84-bdf0-70a8d2145142 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:52.948563 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-99984723-7feb-4c84-bdf0-70a8d2145142 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:52.956433 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-99984723-7feb-4c84-bdf0-70a8d2145142 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.152264 Jul 21 17:53:52.956996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 488/968] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:52 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:53.973426 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f64c7e49-343d-4382-88b8-f782ef25b388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:53.974049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f64c7e49-343d-4382-88b8-f782ef25b388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:53.981430 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f64c7e49-343d-4382-88b8-f782ef25b388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:53.981883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f64c7e49-343d-4382-88b8-f782ef25b388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:53.982653 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f64c7e49-343d-4382-88b8-f782ef25b388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:53.983098 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f64c7e49-343d-4382-88b8-f782ef25b388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:54.110660 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f64c7e49-343d-4382-88b8-f782ef25b388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:54.120056 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f64c7e49-343d-4382-88b8-f782ef25b388 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149901 Jul 21 17:53:54.120662 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 481/969] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:53 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:55.137085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-83ce7421-ec59-4261-adc8-6ae30a356ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:55.137699 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-83ce7421-ec59-4261-adc8-6ae30a356ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:55.144174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-83ce7421-ec59-4261-adc8-6ae30a356ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:55.144670 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-83ce7421-ec59-4261-adc8-6ae30a356ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:55.145431 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-83ce7421-ec59-4261-adc8-6ae30a356ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:55.145869 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-83ce7421-ec59-4261-adc8-6ae30a356ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:55.149840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=78 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:53:55.277995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-83ce7421-ec59-4261-adc8-6ae30a356ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:55.285951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-83ce7421-ec59-4261-adc8-6ae30a356ae6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153354 Jul 21 17:53:55.286520 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 489/970] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:55 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:56.302970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4ef4dc10-60be-42b9-b043-2dc4862fdac1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:56.303488 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4ef4dc10-60be-42b9-b043-2dc4862fdac1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:56.310708 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ef4dc10-60be-42b9-b043-2dc4862fdac1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:56.311160 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ef4dc10-60be-42b9-b043-2dc4862fdac1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:56.311929 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ef4dc10-60be-42b9-b043-2dc4862fdac1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:56.312390 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ef4dc10-60be-42b9-b043-2dc4862fdac1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:56.441171 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4ef4dc10-60be-42b9-b043-2dc4862fdac1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:56.449745 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4ef4dc10-60be-42b9-b043-2dc4862fdac1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.150716 Jul 21 17:53:56.450320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 482/971] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:56 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:57.467209 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b8d07d15-017c-4529-8209-688be7312455 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:57.467830 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b8d07d15-017c-4529-8209-688be7312455 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:57.474367 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b8d07d15-017c-4529-8209-688be7312455 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:57.474818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b8d07d15-017c-4529-8209-688be7312455 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:57.475577 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b8d07d15-017c-4529-8209-688be7312455 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:57.476015 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b8d07d15-017c-4529-8209-688be7312455 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:57.612399 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b8d07d15-017c-4529-8209-688be7312455 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:57.620493 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b8d07d15-017c-4529-8209-688be7312455 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.157119 Jul 21 17:53:57.621289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 490/972] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:57 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:58.637575 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f85ec74a-11df-4d95-9252-faa6278afea4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:58.638200 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f85ec74a-11df-4d95-9252-faa6278afea4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:58.644670 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f85ec74a-11df-4d95-9252-faa6278afea4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:58.645153 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f85ec74a-11df-4d95-9252-faa6278afea4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:58.645934 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f85ec74a-11df-4d95-9252-faa6278afea4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:58.646375 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f85ec74a-11df-4d95-9252-faa6278afea4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:58.778912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f85ec74a-11df-4d95-9252-faa6278afea4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:58.786938 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f85ec74a-11df-4d95-9252-faa6278afea4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153666 Jul 21 17:53:58.787505 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 483/973] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:58 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:53:59.803866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2d33e738-1765-4533-9fa3-08fc890e6fc4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:53:59.804543 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2d33e738-1765-4533-9fa3-08fc890e6fc4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:53:59.811219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d33e738-1765-4533-9fa3-08fc890e6fc4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:59.811676 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d33e738-1765-4533-9fa3-08fc890e6fc4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:59.812504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d33e738-1765-4533-9fa3-08fc890e6fc4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:53:59.812987 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2d33e738-1765-4533-9fa3-08fc890e6fc4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:53:59.943380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2d33e738-1765-4533-9fa3-08fc890e6fc4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:53:59.951351 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2d33e738-1765-4533-9fa3-08fc890e6fc4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151358 Jul 21 17:53:59.951914 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 491/974] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:53:59 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:54:00.968226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-219946df-038b-48cd-8a17-c94dfa82e65e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:54:00.968885 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-219946df-038b-48cd-8a17-c94dfa82e65e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:54:00.975120 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-219946df-038b-48cd-8a17-c94dfa82e65e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:00.975643 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-219946df-038b-48cd-8a17-c94dfa82e65e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:00.976541 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-219946df-038b-48cd-8a17-c94dfa82e65e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:00.977046 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-219946df-038b-48cd-8a17-c94dfa82e65e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:01.110436 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-219946df-038b-48cd-8a17-c94dfa82e65e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:54:01.118244 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-219946df-038b-48cd-8a17-c94dfa82e65e tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153856 Jul 21 17:54:01.119385 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 484/975] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:54:00 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:54:02.135953 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-45472d12-65f1-42f7-8656-3d969961d515 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:54:02.136595 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-45472d12-65f1-42f7-8656-3d969961d515 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:54:02.142698 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-45472d12-65f1-42f7-8656-3d969961d515 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:02.143149 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-45472d12-65f1-42f7-8656-3d969961d515 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:02.143909 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-45472d12-65f1-42f7-8656-3d969961d515 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:02.144375 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-45472d12-65f1-42f7-8656-3d969961d515 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:02.272684 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-45472d12-65f1-42f7-8656-3d969961d515 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:54:02.280760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-45472d12-65f1-42f7-8656-3d969961d515 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.148966 Jul 21 17:54:02.281327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 492/976] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:54:02 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:54:03.297578 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ddd5cd5d-74af-4316-be80-9289b5c932ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:54:03.298197 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ddd5cd5d-74af-4316-be80-9289b5c932ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:54:03.304815 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddd5cd5d-74af-4316-be80-9289b5c932ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:03.305265 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddd5cd5d-74af-4316-be80-9289b5c932ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:03.306605 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddd5cd5d-74af-4316-be80-9289b5c932ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:03.307045 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddd5cd5d-74af-4316-be80-9289b5c932ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:03.435091 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ddd5cd5d-74af-4316-be80-9289b5c932ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:54:03.443339 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ddd5cd5d-74af-4316-be80-9289b5c932ec tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149615 Jul 21 17:54:03.443965 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 485/977] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:54:03 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:54:04.459969 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b9ef8a93-0684-4ead-971e-45d6cb4fc3b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:54:04.460585 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b9ef8a93-0684-4ead-971e-45d6cb4fc3b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:54:04.467676 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b9ef8a93-0684-4ead-971e-45d6cb4fc3b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:04.468127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b9ef8a93-0684-4ead-971e-45d6cb4fc3b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:04.468914 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b9ef8a93-0684-4ead-971e-45d6cb4fc3b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:04.469348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b9ef8a93-0684-4ead-971e-45d6cb4fc3b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:04.596817 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b9ef8a93-0684-4ead-971e-45d6cb4fc3b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:54:04.605254 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b9ef8a93-0684-4ead-971e-45d6cb4fc3b8 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.149104 Jul 21 17:54:04.605808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 493/978] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:54:04 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:54:05.622528 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-53f296d1-41f7-4623-976c-01ebec4e0fbb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:54:05.623148 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-53f296d1-41f7-4623-976c-01ebec4e0fbb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:54:05.629698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53f296d1-41f7-4623-976c-01ebec4e0fbb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:05.630149 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53f296d1-41f7-4623-976c-01ebec4e0fbb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:05.630910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53f296d1-41f7-4623-976c-01ebec4e0fbb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:05.631351 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53f296d1-41f7-4623-976c-01ebec4e0fbb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:05.760669 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-53f296d1-41f7-4623-976c-01ebec4e0fbb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:54:05.769407 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-53f296d1-41f7-4623-976c-01ebec4e0fbb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.151270 Jul 21 17:54:05.769974 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 486/979] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:54:05 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:54:05.843090 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 21 17:54:05.843250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 17:54:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:54:06.786862 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c78c615c-5978-47d8-ac1a-7291a0b7fa37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:54:06.787474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c78c615c-5978-47d8-ac1a-7291a0b7fa37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:54:06.794520 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c78c615c-5978-47d8-ac1a-7291a0b7fa37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:06.794969 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c78c615c-5978-47d8-ac1a-7291a0b7fa37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:06.795725 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c78c615c-5978-47d8-ac1a-7291a0b7fa37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:06.796156 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c78c615c-5978-47d8-ac1a-7291a0b7fa37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:06.933398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c78c615c-5978-47d8-ac1a-7291a0b7fa37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:54:06.941678 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c78c615c-5978-47d8-ac1a-7291a0b7fa37 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.158674 Jul 21 17:54:06.942247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 494/980] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:54:06 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:54:07.959025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-86504d30-6a8c-47fc-8904-58a26c7ab4f1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:54:07.959695 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-86504d30-6a8c-47fc-8904-58a26c7ab4f1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: e14c1a66-269c-4e3f-95f6-6388fe5c16c1] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:54:07.962668 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=26 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:54:07.967921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86504d30-6a8c-47fc-8904-58a26c7ab4f1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:07.968401 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86504d30-6a8c-47fc-8904-58a26c7ab4f1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:07.969177 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86504d30-6a8c-47fc-8904-58a26c7ab4f1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:54:07.969617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86504d30-6a8c-47fc-8904-58a26c7ab4f1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:54:08.100189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-86504d30-6a8c-47fc-8904-58a26c7ab4f1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:54:08.108377 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-86504d30-6a8c-47fc-8904-58a26c7ab4f1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1" status: 200 len: 1559 microversion: 2.1 time: 0.153351 Jul 21 17:54:08.108941 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 487/981] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:54:07 2022] GET /compute/v2.1/servers/e14c1a66-269c-4e3f-95f6-6388fe5c16c1 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:54:13.907051 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 21 17:54:13.907773 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 17:54:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:54:18.072507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 21 17:54:18.073141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 17:54:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:55:04.069360 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-90023a4c-ddbf-4ff1-bf52-7f5e59de8064 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:04.069992 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-90023a4c-ddbf-4ff1-bf52-7f5e59de8064 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:04.073840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=23 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:04.074653 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=35 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:04.079580 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-90023a4c-ddbf-4ff1-bf52-7f5e59de8064 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:04.080087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-90023a4c-ddbf-4ff1-bf52-7f5e59de8064 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:04.080904 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-90023a4c-ddbf-4ff1-bf52-7f5e59de8064 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:04.081339 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-90023a4c-ddbf-4ff1-bf52-7f5e59de8064 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:04.106765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-90023a4c-ddbf-4ff1-bf52-7f5e59de8064 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Going to try to terminate instance {{(pid=124381) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 17:55:04.162906 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR oslo.messaging._drivers.impl_rabbit [None req-90023a4c-ddbf-4ff1-bf52-7f5e59de8064 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [16edfd3d-351b-425a-bd7f-767bb633dc28] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 17:55:05.171356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [None req-90023a4c-ddbf-4ff1-bf52-7f5e59de8064 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [16edfd3d-351b-425a-bd7f-767bb633dc28] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 41232. Jul 21 17:55:05.190915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-90023a4c-ddbf-4ff1-bf52-7f5e59de8064 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "DELETE /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 204 len: 0 microversion: 2.1 time: 1.125192 Jul 21 17:55:05.191554 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 495/982] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 17:55:04 2022] DELETE /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 0 bytes in 1127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 17:55:05.201059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b00cef47-d7c1-4d73-8676-f7456cea0794 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:05.201714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b00cef47-d7c1-4d73-8676-f7456cea0794 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:05.203712 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:05.204449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=77 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:05.210315 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b00cef47-d7c1-4d73-8676-f7456cea0794 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:05.210777 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b00cef47-d7c1-4d73-8676-f7456cea0794 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:05.211547 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b00cef47-d7c1-4d73-8676-f7456cea0794 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:05.211994 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b00cef47-d7c1-4d73-8676-f7456cea0794 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:05.340621 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b00cef47-d7c1-4d73-8676-f7456cea0794 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:05.348081 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b00cef47-d7c1-4d73-8676-f7456cea0794 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1509 microversion: 2.1 time: 0.151903 Jul 21 17:55:05.348674 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 488/983] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:05 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:55:06.364748 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a787c3c0-0131-48a3-8831-eb71f497b9ed tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:06.365482 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a787c3c0-0131-48a3-8831-eb71f497b9ed tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:06.373980 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a787c3c0-0131-48a3-8831-eb71f497b9ed tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:06.374437 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a787c3c0-0131-48a3-8831-eb71f497b9ed tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:06.375248 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a787c3c0-0131-48a3-8831-eb71f497b9ed tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:06.375712 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a787c3c0-0131-48a3-8831-eb71f497b9ed tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:06.443056 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a787c3c0-0131-48a3-8831-eb71f497b9ed tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:06.452095 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a787c3c0-0131-48a3-8831-eb71f497b9ed tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 200 len: 1467 microversion: 2.1 time: 0.091487 Jul 21 17:55:06.453031 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 496/984] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:06 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 1467 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:55:06.645094 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-5c39417b-d1d2-4be5-8b9a-79811a6ae402 req-72ee85cd-061e-4d8b-84b8-d6abf0684833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "763d9b30-7ec8-42e4-9a88-2b7ff3a771cd", "name": "network-vif-deleted", "tag": "34e81461-bec9-492f-a85f-2fc89ebdc164"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:55:06.653418 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-5c39417b-d1d2-4be5-8b9a-79811a6ae402 req-72ee85cd-061e-4d8b-84b8-d6abf0684833 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:06.653869 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-5c39417b-d1d2-4be5-8b9a-79811a6ae402 req-72ee85cd-061e-4d8b-84b8-d6abf0684833 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:06.664981 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-5c39417b-d1d2-4be5-8b9a-79811a6ae402 req-72ee85cd-061e-4d8b-84b8-d6abf0684833 service nova] Creating event network-vif-deleted:34e81461-bec9-492f-a85f-2fc89ebdc164 for instance 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd on hv-cinder-82549 Jul 21 17:55:06.671665 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-5c39417b-d1d2-4be5-8b9a-79811a6ae402 req-72ee85cd-061e-4d8b-84b8-d6abf0684833 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182083 Jul 21 17:55:06.672245 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 489/985] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:55:07.470152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-687a0a3d-a4bc-431b-97f4-fa0636611617 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:07.470803 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-687a0a3d-a4bc-431b-97f4-fa0636611617 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:07.477306 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-687a0a3d-a4bc-431b-97f4-fa0636611617 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:07.477765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-687a0a3d-a4bc-431b-97f4-fa0636611617 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:07.478534 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-687a0a3d-a4bc-431b-97f4-fa0636611617 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:07.478976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-687a0a3d-a4bc-431b-97f4-fa0636611617 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:07.492570 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-687a0a3d-a4bc-431b-97f4-fa0636611617 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] HTTP exception thrown: Instance 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd could not be found. Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-687a0a3d-a4bc-431b-97f4-fa0636611617 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Request method failure captured: Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd HTTP/1.1 Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Y4Wigurc0zXrCHCWwtYR8gdbXlP7tMhp1C8KrLHmYYBi72WjrUqyNf1xGxUyO6sshaPc_BNy-PWUDwstd884Ayki6iaa-IHO4U4gg8ZNrySq_2mQ6Dm5qSankL8WlsYAtpgqOoRzyTdFVQHgSPLvNziBS-HrJTcvFsuqE6-93d3t2c Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 21c11b3abe754d86919bbcf31ecb312a Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-178059006 Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 17:55:07.494189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 17:55:07.495882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/21c11b3abe754d86919bbcf31ecb312a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/21c11b3abe754d86919bbcf31ecb312a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_21c11b3abe754d86919bbcf31ecb312a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/21c11b3abe754d86919bbcf31ecb312a"}]}] Jul 21 17:55:07.495882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-ServerRescueNegativeTestJSON-178059006 Jul 21 17:55:07.495882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 21c11b3abe754d86919bbcf31ecb312a Jul 21 17:55:07.495882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-178059006 Jul 21 17:55:07.495882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-ServerRescueNegativeTestJSON-178059006-project Jul 21 17:55:07.495882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 17:55:07.495882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 17:55:07.495882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 1bf6e7a4afaf405caae7d750973d9956 Jul 21 17:55:07.495882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-ServerRescueNegativeTestJSON-178059006-project Jul 21 17:55:07.495882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 17:55:07.495882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd could not be found. Jul 21 17:55:07.495882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '763d9b30-7ec8-42e4-9a88-2b7ff3a771cd'} Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd could not be found. Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:55:07.496902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd could not be found. Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd could not be found. Jul 21 17:55:07.498459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 17:55:07.499993 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-687a0a3d-a4bc-431b-97f4-fa0636611617 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Returning 404 to user: Instance 763d9b30-7ec8-42e4-9a88-2b7ff3a771cd could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:55:07.499993 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-687a0a3d-a4bc-431b-97f4-fa0636611617 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd" status: 404 len: 111 microversion: 2.1 time: 0.029444 Jul 21 17:55:07.499993 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 497/986] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:07 2022] GET /compute/v2.1/servers/763d9b30-7ec8-42e4-9a88-2b7ff3a771cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 17:55:07.505342 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-379cc26f-c61e-4135-b7de-8520de7c6ad0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:07.505929 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-379cc26f-c61e-4135-b7de-8520de7c6ad0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:07.512698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-379cc26f-c61e-4135-b7de-8520de7c6ad0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:07.513151 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-379cc26f-c61e-4135-b7de-8520de7c6ad0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:07.513917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-379cc26f-c61e-4135-b7de-8520de7c6ad0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:07.514355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-379cc26f-c61e-4135-b7de-8520de7c6ad0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:07.538632 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-379cc26f-c61e-4135-b7de-8520de7c6ad0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 17:55:07.614904 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-379cc26f-c61e-4135-b7de-8520de7c6ad0 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 204 len: 0 microversion: 2.1 time: 0.113363 Jul 21 17:55:07.615497 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 490/987] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 17:55:07 2022] DELETE /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 17:55:07.623414 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7d923b2f-be2e-41bc-b5a7-9acf7a6fd771 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:07.624114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7d923b2f-be2e-41bc-b5a7-9acf7a6fd771 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:07.630230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d923b2f-be2e-41bc-b5a7-9acf7a6fd771 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:07.630689 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d923b2f-be2e-41bc-b5a7-9acf7a6fd771 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:07.631480 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d923b2f-be2e-41bc-b5a7-9acf7a6fd771 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:07.631922 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d923b2f-be2e-41bc-b5a7-9acf7a6fd771 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:07.765853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7d923b2f-be2e-41bc-b5a7-9acf7a6fd771 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:07.773428 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7d923b2f-be2e-41bc-b5a7-9acf7a6fd771 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1522 microversion: 2.1 time: 0.153950 Jul 21 17:55:07.773978 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 498/988] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:07 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:55:08.687531 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-31bfecc6-bbeb-437f-82d1-9d5301a94b98 req-9c028630-cd20-454a-ae5c-83ffbf04818a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b7093e-b70d-4a59-bc9a-e08264c48761", "name": "network-vif-deleted", "tag": "f6f5a2be-a21c-4d5e-8942-24180cec25a3"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:55:08.696695 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-31bfecc6-bbeb-437f-82d1-9d5301a94b98 req-9c028630-cd20-454a-ae5c-83ffbf04818a service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:08.697145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-31bfecc6-bbeb-437f-82d1-9d5301a94b98 req-9c028630-cd20-454a-ae5c-83ffbf04818a service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:08.709491 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-31bfecc6-bbeb-437f-82d1-9d5301a94b98 req-9c028630-cd20-454a-ae5c-83ffbf04818a service nova] Creating event network-vif-deleted:f6f5a2be-a21c-4d5e-8942-24180cec25a3 for instance f2b7093e-b70d-4a59-bc9a-e08264c48761 on hv-cinder-82549 Jul 21 17:55:08.714028 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-31bfecc6-bbeb-437f-82d1-9d5301a94b98 req-9c028630-cd20-454a-ae5c-83ffbf04818a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030663 Jul 21 17:55:08.714611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 491/989] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:55:08.790762 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-74000489-6b94-425a-b6de-2f67faf374ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:08.791375 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-74000489-6b94-425a-b6de-2f67faf374ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:08.798595 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-74000489-6b94-425a-b6de-2f67faf374ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:08.799048 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-74000489-6b94-425a-b6de-2f67faf374ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:08.799824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-74000489-6b94-425a-b6de-2f67faf374ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:08.800266 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-74000489-6b94-425a-b6de-2f67faf374ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:08.831799 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-74000489-6b94-425a-b6de-2f67faf374ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:08.832186 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-74000489-6b94-425a-b6de-2f67faf374ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:08.832685 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.objects.instance [None req-74000489-6b94-425a-b6de-2f67faf374ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lazy-loading 'fault' on Instance uuid f2b7093e-b70d-4a59-bc9a-e08264c48761 {{(pid=124381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 17:55:08.877426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-74000489-6b94-425a-b6de-2f67faf374ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bf6e7a4afaf405caae7d750973d9956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c11b3abe754d86919bbcf31ecb312a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:08.885149 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-74000489-6b94-425a-b6de-2f67faf374ef tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 200 len: 1312 microversion: 2.1 time: 0.098290 Jul 21 17:55:08.885719 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 499/990] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:08 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:55:09.904120 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f018d51c-ad44-408c-8688-28718a9fb098 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:09.904855 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f018d51c-ad44-408c-8688-28718a9fb098 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] [instance: f2b7093e-b70d-4a59-bc9a-e08264c48761] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:09.911207 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f018d51c-ad44-408c-8688-28718a9fb098 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:09.911662 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f018d51c-ad44-408c-8688-28718a9fb098 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:09.912476 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f018d51c-ad44-408c-8688-28718a9fb098 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:09.912925 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f018d51c-ad44-408c-8688-28718a9fb098 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:09.928561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-f018d51c-ad44-408c-8688-28718a9fb098 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] HTTP exception thrown: Instance f2b7093e-b70d-4a59-bc9a-e08264c48761 could not be found. Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f018d51c-ad44-408c-8688-28718a9fb098 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Request method failure captured: Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 HTTP/1.1 Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y4Wigurc0zXrCHCWwtYR8gdbXlP7tMhp1C8KrLHmYYBi72WjrUqyNf1xGxUyO6sshaPc_BNy-PWUDwstd884Ayki6iaa-IHO4U4gg8ZNrySq_2mQ6Dm5qSankL8WlsYAtpgqOoRzyTdFVQHgSPLvNziBS-HrJTcvFsuqE6-93d3t2c Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 21c11b3abe754d86919bbcf31ecb312a Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-178059006 Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 17:55:09.930233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 17:55:09.931826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/21c11b3abe754d86919bbcf31ecb312a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/21c11b3abe754d86919bbcf31ecb312a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_21c11b3abe754d86919bbcf31ecb312a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/21c11b3abe754d86919bbcf31ecb312a"}]}] Jul 21 17:55:09.931826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-ServerRescueNegativeTestJSON-178059006 Jul 21 17:55:09.931826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 21c11b3abe754d86919bbcf31ecb312a Jul 21 17:55:09.931826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-178059006 Jul 21 17:55:09.931826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-ServerRescueNegativeTestJSON-178059006-project Jul 21 17:55:09.931826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 17:55:09.931826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 17:55:09.931826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: 1bf6e7a4afaf405caae7d750973d9956 Jul 21 17:55:09.931826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-ServerRescueNegativeTestJSON-178059006-project Jul 21 17:55:09.931826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 17:55:09.931826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance f2b7093e-b70d-4a59-bc9a-e08264c48761 could not be found. Jul 21 17:55:09.931826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': 'f2b7093e-b70d-4a59-bc9a-e08264c48761'} Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b7093e-b70d-4a59-bc9a-e08264c48761 could not be found. Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:55:09.932894 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b7093e-b70d-4a59-bc9a-e08264c48761 could not be found. Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b7093e-b70d-4a59-bc9a-e08264c48761 could not be found. Jul 21 17:55:09.934405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:55:09.935732 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f018d51c-ad44-408c-8688-28718a9fb098 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] Returning 404 to user: Instance f2b7093e-b70d-4a59-bc9a-e08264c48761 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:55:09.935732 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f018d51c-ad44-408c-8688-28718a9fb098 tempest-ServerRescueNegativeTestJSON-178059006 tempest-ServerRescueNegativeTestJSON-178059006-project] 10.222.0.57 "GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761" status: 404 len: 111 microversion: 2.1 time: 0.033156 Jul 21 17:55:09.935732 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 492/991] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:09 2022] GET /compute/v2.1/servers/f2b7093e-b70d-4a59-bc9a-e08264c48761 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 17:55:19.145052 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:19.145745 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:19.262452 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-255891ab-517e-42cb-997b-72cd51abb971 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Action: 'create', calling method: .version_select at 0x7ffa2a4c8700>, body: {"keypair": {"name": "tempest-keypair-1906429763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGhtMNFh2l8p2r+kjcn4GUzVJRYbD16TcZNUyaCABTEJ8KVL0tT1Wvkmx9IMHQROmVg74CyiEEsUqnCsj4Rcbwt36TAgH7BxJpJTRkUFOPtp3aUGrYa/Enb9Kxy6KX5KA=="}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:55:19.276541 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-255891ab-517e-42cb-997b-72cd51abb971 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Getting quotas for project 444abcf11d564f7692af245f2bd98a84. Resources: {'key_pairs'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:55:19.281038 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-255891ab-517e-42cb-997b-72cd51abb971 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Getting quotas for user d08a5eaa6d814e388b0af0581a530888 and project 444abcf11d564f7692af245f2bd98a84. Resources: {'key_pairs'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:55:19.307960 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-255891ab-517e-42cb-997b-72cd51abb971 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.169125 Jul 21 17:55:19.308535 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 500/992] 10.222.0.57 () {62 vars in 1199 bytes} [Thu Jul 21 17:55:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 170 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 21 17:55:20.537833 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1526739263", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d68f3fcc-4da8-481a-a69e-0d9c32bbf89c"}], "security_groups": [{"name": "tempest-securitygroup--295317143"}], "key_name": "tempest-keypair-1906429763", "user_data": "}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:55:20.545593 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:20.546256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:20.661693 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] validate_networks() for [('d68f3fcc-4da8-481a-a69e-0d9c32bbf89c', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 17:55:21.180638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 17:55:21.181071 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 17:55:21.181550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 17:55:21.181966 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 17:55:21.182383 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 17:55:21.191658 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:21.192107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:21.192971 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:21.193413 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:21.211312 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Getting quotas for project 444abcf11d564f7692af245f2bd98a84. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 17:55:21.216201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Getting quotas for user d08a5eaa6d814e388b0af0581a530888 and project 444abcf11d564f7692af245f2bd98a84. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 17:55:21.228115 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 17:55:21.230439 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 17:55:21.278247 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [df4c8137-8d93-4049-94d8-9c32f123599f] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 17:55:22.286058 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [df4c8137-8d93-4049-94d8-9c32f123599f] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 41470. Jul 21 17:55:22.291269 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-27237c27-5483-4430-bc78-25ddc550621c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.757898 Jul 21 17:55:22.292146 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 493/993] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jul 21 17:55:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 17:55:22.302845 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3fa02d12-0338-444a-97d7-f8bb5fc0bb31 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:22.303471 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3fa02d12-0338-444a-97d7-f8bb5fc0bb31 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:22.365403 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3fa02d12-0338-444a-97d7-f8bb5fc0bb31 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:22.374111 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3fa02d12-0338-444a-97d7-f8bb5fc0bb31 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:22.375622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3fa02d12-0338-444a-97d7-f8bb5fc0bb31 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:22.376918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3fa02d12-0338-444a-97d7-f8bb5fc0bb31 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1282 microversion: 2.20 time: 0.078058 Jul 21 17:55:22.377464 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 501/994] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:22 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 17:55:23.395598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-24859a6c-4844-4929-9a89-746f759377f2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:23.396244 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-24859a6c-4844-4929-9a89-746f759377f2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:23.452123 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-24859a6c-4844-4929-9a89-746f759377f2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:23.459301 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-24859a6c-4844-4929-9a89-746f759377f2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:23.460831 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-24859a6c-4844-4929-9a89-746f759377f2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:23.461919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-24859a6c-4844-4929-9a89-746f759377f2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1282 microversion: 2.20 time: 0.070672 Jul 21 17:55:23.462475 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 494/995] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:23 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:55:24.479990 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-80541cac-25d9-47be-ad72-79fa9591a60d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:24.480693 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-80541cac-25d9-47be-ad72-79fa9591a60d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:24.487364 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80541cac-25d9-47be-ad72-79fa9591a60d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:24.487808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80541cac-25d9-47be-ad72-79fa9591a60d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:24.488620 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80541cac-25d9-47be-ad72-79fa9591a60d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:24.489050 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80541cac-25d9-47be-ad72-79fa9591a60d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:24.557722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-80541cac-25d9-47be-ad72-79fa9591a60d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:24.567243 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-80541cac-25d9-47be-ad72-79fa9591a60d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:24.569238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-80541cac-25d9-47be-ad72-79fa9591a60d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:24.570168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-80541cac-25d9-47be-ad72-79fa9591a60d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1286 microversion: 2.20 time: 0.094184 Jul 21 17:55:24.570711 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 502/996] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:24 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:55:25.588814 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b423e0b8-96d9-41ea-8968-2fcade51b5c0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:25.590837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b423e0b8-96d9-41ea-8968-2fcade51b5c0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:25.597631 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b423e0b8-96d9-41ea-8968-2fcade51b5c0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:25.598356 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b423e0b8-96d9-41ea-8968-2fcade51b5c0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:25.599330 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b423e0b8-96d9-41ea-8968-2fcade51b5c0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:25.600176 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b423e0b8-96d9-41ea-8968-2fcade51b5c0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:25.676140 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b423e0b8-96d9-41ea-8968-2fcade51b5c0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:25.686358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b423e0b8-96d9-41ea-8968-2fcade51b5c0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:25.687972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b423e0b8-96d9-41ea-8968-2fcade51b5c0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:25.689593 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b423e0b8-96d9-41ea-8968-2fcade51b5c0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1352 microversion: 2.20 time: 0.104790 Jul 21 17:55:25.690421 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 495/997] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:25 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:55:26.711404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-271f4658-c730-4d5b-85bc-75c5cbbcb57e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:26.715257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-271f4658-c730-4d5b-85bc-75c5cbbcb57e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:26.725945 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-271f4658-c730-4d5b-85bc-75c5cbbcb57e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:26.726405 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-271f4658-c730-4d5b-85bc-75c5cbbcb57e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:26.727186 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-271f4658-c730-4d5b-85bc-75c5cbbcb57e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:26.729482 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-271f4658-c730-4d5b-85bc-75c5cbbcb57e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:26.862574 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-271f4658-c730-4d5b-85bc-75c5cbbcb57e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:26.871972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-271f4658-c730-4d5b-85bc-75c5cbbcb57e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:26.873538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-271f4658-c730-4d5b-85bc-75c5cbbcb57e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:26.874656 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-271f4658-c730-4d5b-85bc-75c5cbbcb57e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1407 microversion: 2.20 time: 0.169293 Jul 21 17:55:26.875216 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 503/998] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:26 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:55:27.224109 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-02e43aee-4f1d-48d1-8d9a-6c610c3ad5cf req-789e560c-8fdc-452b-ae03-854b2ee963ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38995733-7a8d-41fd-8517-ad9b23969807", "tag": "46810c91-72c1-4c7e-b1e5-9779dda54481"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:55:27.244006 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-02e43aee-4f1d-48d1-8d9a-6c610c3ad5cf req-789e560c-8fdc-452b-ae03-854b2ee963ae service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:27.244600 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-02e43aee-4f1d-48d1-8d9a-6c610c3ad5cf req-789e560c-8fdc-452b-ae03-854b2ee963ae service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:27.261117 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-02e43aee-4f1d-48d1-8d9a-6c610c3ad5cf req-789e560c-8fdc-452b-ae03-854b2ee963ae service nova] Creating event network-changed:46810c91-72c1-4c7e-b1e5-9779dda54481 for instance 38995733-7a8d-41fd-8517-ad9b23969807 on hv-cinder-82549 Jul 21 17:55:27.269716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-02e43aee-4f1d-48d1-8d9a-6c610c3ad5cf req-789e560c-8fdc-452b-ae03-854b2ee963ae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053702 Jul 21 17:55:27.270991 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 496/999] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:55:27.892753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-96a4cf91-54f0-4f11-88ce-93e9cdea020e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:27.893359 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-96a4cf91-54f0-4f11-88ce-93e9cdea020e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:27.899781 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-96a4cf91-54f0-4f11-88ce-93e9cdea020e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:27.900229 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-96a4cf91-54f0-4f11-88ce-93e9cdea020e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:27.901019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-96a4cf91-54f0-4f11-88ce-93e9cdea020e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:27.901454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-96a4cf91-54f0-4f11-88ce-93e9cdea020e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:28.030989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-96a4cf91-54f0-4f11-88ce-93e9cdea020e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:28.038829 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-96a4cf91-54f0-4f11-88ce-93e9cdea020e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:28.040351 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-96a4cf91-54f0-4f11-88ce-93e9cdea020e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:28.041441 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-96a4cf91-54f0-4f11-88ce-93e9cdea020e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1407 microversion: 2.20 time: 0.152778 Jul 21 17:55:28.041989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 504/1000] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:27 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:55:29.060498 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-56ce1e1c-dbee-4aff-8c32-6d7036dc76fc tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:29.061206 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-56ce1e1c-dbee-4aff-8c32-6d7036dc76fc tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:29.067712 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-56ce1e1c-dbee-4aff-8c32-6d7036dc76fc tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:29.068165 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-56ce1e1c-dbee-4aff-8c32-6d7036dc76fc tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:29.068962 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-56ce1e1c-dbee-4aff-8c32-6d7036dc76fc tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:29.069404 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-56ce1e1c-dbee-4aff-8c32-6d7036dc76fc tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:29.197237 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-56ce1e1c-dbee-4aff-8c32-6d7036dc76fc tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:29.205451 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-56ce1e1c-dbee-4aff-8c32-6d7036dc76fc tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:29.206959 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-56ce1e1c-dbee-4aff-8c32-6d7036dc76fc tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:29.208062 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-56ce1e1c-dbee-4aff-8c32-6d7036dc76fc tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1407 microversion: 2.20 time: 0.152918 Jul 21 17:55:29.208647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 497/1001] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:29 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 17:55:30.225995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fc324615-c57e-4972-9f8c-51ec7120c197 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:30.226562 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fc324615-c57e-4972-9f8c-51ec7120c197 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:30.233158 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fc324615-c57e-4972-9f8c-51ec7120c197 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:30.233613 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fc324615-c57e-4972-9f8c-51ec7120c197 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:30.234380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fc324615-c57e-4972-9f8c-51ec7120c197 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:30.234818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fc324615-c57e-4972-9f8c-51ec7120c197 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:30.367360 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-fc324615-c57e-4972-9f8c-51ec7120c197 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:30.376322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-fc324615-c57e-4972-9f8c-51ec7120c197 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:30.377839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-fc324615-c57e-4972-9f8c-51ec7120c197 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:30.378936 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fc324615-c57e-4972-9f8c-51ec7120c197 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1407 microversion: 2.20 time: 0.156939 Jul 21 17:55:30.379683 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 505/1002] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:30 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:55:31.396525 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ecea0d64-50e3-4e3d-8f81-7044f6a7cbbf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:31.397137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ecea0d64-50e3-4e3d-8f81-7044f6a7cbbf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:31.399102 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:31.405506 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ecea0d64-50e3-4e3d-8f81-7044f6a7cbbf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:31.405954 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ecea0d64-50e3-4e3d-8f81-7044f6a7cbbf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:31.406719 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ecea0d64-50e3-4e3d-8f81-7044f6a7cbbf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:31.407159 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ecea0d64-50e3-4e3d-8f81-7044f6a7cbbf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:31.537902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ecea0d64-50e3-4e3d-8f81-7044f6a7cbbf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:31.546257 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ecea0d64-50e3-4e3d-8f81-7044f6a7cbbf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:31.547912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ecea0d64-50e3-4e3d-8f81-7044f6a7cbbf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:31.549193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ecea0d64-50e3-4e3d-8f81-7044f6a7cbbf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1407 microversion: 2.20 time: 0.156710 Jul 21 17:55:31.550074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 498/1003] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:31 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:55:32.567061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-98b6a04e-db83-460a-a391-0a55940438a2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:32.567754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-98b6a04e-db83-460a-a391-0a55940438a2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:32.569852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=6 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:32.577389 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98b6a04e-db83-460a-a391-0a55940438a2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:32.577837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98b6a04e-db83-460a-a391-0a55940438a2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:32.578609 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98b6a04e-db83-460a-a391-0a55940438a2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:32.579048 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98b6a04e-db83-460a-a391-0a55940438a2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:32.857304 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-98b6a04e-db83-460a-a391-0a55940438a2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:32.865328 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-98b6a04e-db83-460a-a391-0a55940438a2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:32.866851 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-98b6a04e-db83-460a-a391-0a55940438a2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:32.867957 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-98b6a04e-db83-460a-a391-0a55940438a2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1407 microversion: 2.20 time: 0.305197 Jul 21 17:55:32.868540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 506/1004] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:32 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:55:33.885748 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6142092a-2f53-4287-91bc-cd4260cb4244 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:33.887079 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6142092a-2f53-4287-91bc-cd4260cb4244 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:33.889537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=8 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:33.894919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6142092a-2f53-4287-91bc-cd4260cb4244 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:33.895379 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6142092a-2f53-4287-91bc-cd4260cb4244 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:33.896151 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6142092a-2f53-4287-91bc-cd4260cb4244 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:33.896628 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6142092a-2f53-4287-91bc-cd4260cb4244 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:34.028463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6142092a-2f53-4287-91bc-cd4260cb4244 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:34.036464 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6142092a-2f53-4287-91bc-cd4260cb4244 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:34.038012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6142092a-2f53-4287-91bc-cd4260cb4244 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:34.039137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6142092a-2f53-4287-91bc-cd4260cb4244 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1407 microversion: 2.20 time: 0.157272 Jul 21 17:55:34.039687 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 499/1005] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:33 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:55:34.449462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-d8bbd2f9-b97b-4386-9ea5-30d9950f8017 req-5d826c95-3cbf-4196-a7c4-d40c3cf265e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38995733-7a8d-41fd-8517-ad9b23969807", "name": "network-vif-plugged", "status": "completed", "tag": "46810c91-72c1-4c7e-b1e5-9779dda54481"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:55:34.457535 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-d8bbd2f9-b97b-4386-9ea5-30d9950f8017 req-5d826c95-3cbf-4196-a7c4-d40c3cf265e8 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:34.458460 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-d8bbd2f9-b97b-4386-9ea5-30d9950f8017 req-5d826c95-3cbf-4196-a7c4-d40c3cf265e8 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:34.469226 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-d8bbd2f9-b97b-4386-9ea5-30d9950f8017 req-5d826c95-3cbf-4196-a7c4-d40c3cf265e8 service nova] Creating event network-vif-plugged:46810c91-72c1-4c7e-b1e5-9779dda54481 for instance 38995733-7a8d-41fd-8517-ad9b23969807 on hv-cinder-82549 Jul 21 17:55:34.474130 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-d8bbd2f9-b97b-4386-9ea5-30d9950f8017 req-5d826c95-3cbf-4196-a7c4-d40c3cf265e8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085979 Jul 21 17:55:34.474690 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 507/1006] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:55:35.057221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c61af1eb-6a48-4301-bb55-b21de297409c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:35.058364 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c61af1eb-6a48-4301-bb55-b21de297409c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:35.065514 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c61af1eb-6a48-4301-bb55-b21de297409c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:35.065974 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c61af1eb-6a48-4301-bb55-b21de297409c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:35.066750 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c61af1eb-6a48-4301-bb55-b21de297409c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:35.067199 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c61af1eb-6a48-4301-bb55-b21de297409c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:35.199780 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c61af1eb-6a48-4301-bb55-b21de297409c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:35.207610 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c61af1eb-6a48-4301-bb55-b21de297409c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:35.209141 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c61af1eb-6a48-4301-bb55-b21de297409c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:35.210238 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c61af1eb-6a48-4301-bb55-b21de297409c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1407 microversion: 2.20 time: 0.156855 Jul 21 17:55:35.210789 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 500/1007] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:35 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 17:55:36.229788 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-739a762a-3599-413e-8669-c95088244dd6 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:36.230481 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-739a762a-3599-413e-8669-c95088244dd6 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:36.237160 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-739a762a-3599-413e-8669-c95088244dd6 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:36.237613 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-739a762a-3599-413e-8669-c95088244dd6 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:36.238379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-739a762a-3599-413e-8669-c95088244dd6 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:36.238816 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-739a762a-3599-413e-8669-c95088244dd6 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:36.375982 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-739a762a-3599-413e-8669-c95088244dd6 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:36.384058 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-739a762a-3599-413e-8669-c95088244dd6 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:36.385611 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-739a762a-3599-413e-8669-c95088244dd6 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:36.387763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-739a762a-3599-413e-8669-c95088244dd6 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1598 microversion: 2.20 time: 0.162690 Jul 21 17:55:36.388339 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 508/1008] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 17:55:36 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 17:55:36.405335 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-49a7d04b-7fec-48f1-83a1-4b14754b754a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:36.405852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-49a7d04b-7fec-48f1-83a1-4b14754b754a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:36.412359 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49a7d04b-7fec-48f1-83a1-4b14754b754a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:36.412820 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49a7d04b-7fec-48f1-83a1-4b14754b754a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:36.413597 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49a7d04b-7fec-48f1-83a1-4b14754b754a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:36.414040 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49a7d04b-7fec-48f1-83a1-4b14754b754a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:36.489720 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-49a7d04b-7fec-48f1-83a1-4b14754b754a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088929 Jul 21 17:55:36.490315 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 501/1009] 10.222.0.57 () {60 vars in 1315 bytes} [Thu Jul 21 17:55:36 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:55:37.694088 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-83b41a64-aa81-4ce4-88ed-2abe09002901 req-f2e6db27-47ac-450b-86ca-8f127df1e485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38995733-7a8d-41fd-8517-ad9b23969807", "tag": "46810c91-72c1-4c7e-b1e5-9779dda54481"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:55:37.703005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-83b41a64-aa81-4ce4-88ed-2abe09002901 req-f2e6db27-47ac-450b-86ca-8f127df1e485 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:37.703430 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-83b41a64-aa81-4ce4-88ed-2abe09002901 req-f2e6db27-47ac-450b-86ca-8f127df1e485 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:37.714737 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-83b41a64-aa81-4ce4-88ed-2abe09002901 req-f2e6db27-47ac-450b-86ca-8f127df1e485 service nova] Creating event network-changed:46810c91-72c1-4c7e-b1e5-9779dda54481 for instance 38995733-7a8d-41fd-8517-ad9b23969807 on hv-cinder-82549 Jul 21 17:55:37.720221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-83b41a64-aa81-4ce4-88ed-2abe09002901 req-f2e6db27-47ac-450b-86ca-8f127df1e485 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084714 Jul 21 17:55:37.720836 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 509/1010] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:55:48.421774 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:48.422617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=38 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:48.426550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-32c41f25-a835-41b9-aa7a-15b3c5c19b3a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:48.427053 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-32c41f25-a835-41b9-aa7a-15b3c5c19b3a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:48.434555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32c41f25-a835-41b9-aa7a-15b3c5c19b3a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:48.435010 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32c41f25-a835-41b9-aa7a-15b3c5c19b3a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:48.435786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32c41f25-a835-41b9-aa7a-15b3c5c19b3a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:48.436225 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32c41f25-a835-41b9-aa7a-15b3c5c19b3a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:48.461188 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-32c41f25-a835-41b9-aa7a-15b3c5c19b3a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 17:55:48.537910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-32c41f25-a835-41b9-aa7a-15b3c5c19b3a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 204 len: 0 microversion: 2.1 time: 0.117139 Jul 21 17:55:48.538573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 502/1011] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 17:55:48 2022] DELETE /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 17:55:48.548673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-157a27b1-2040-4a7f-8670-5746cda367d4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:48.550139 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-157a27b1-2040-4a7f-8670-5746cda367d4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:48.552882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:48.553528 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=40 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:55:48.559726 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-157a27b1-2040-4a7f-8670-5746cda367d4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:48.560177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-157a27b1-2040-4a7f-8670-5746cda367d4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:48.560967 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-157a27b1-2040-4a7f-8670-5746cda367d4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:48.561402 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-157a27b1-2040-4a7f-8670-5746cda367d4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:48.688640 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-157a27b1-2040-4a7f-8670-5746cda367d4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:48.696590 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-157a27b1-2040-4a7f-8670-5746cda367d4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1679 microversion: 2.1 time: 0.152239 Jul 21 17:55:48.697146 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 510/1012] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:48 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:55:49.717686 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4d22bab0-8b15-498c-8e6a-55b26dffe4e5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:49.718395 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4d22bab0-8b15-498c-8e6a-55b26dffe4e5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:49.725027 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d22bab0-8b15-498c-8e6a-55b26dffe4e5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:49.725471 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d22bab0-8b15-498c-8e6a-55b26dffe4e5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:49.726240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d22bab0-8b15-498c-8e6a-55b26dffe4e5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:49.726673 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d22bab0-8b15-498c-8e6a-55b26dffe4e5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:49.798767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4d22bab0-8b15-498c-8e6a-55b26dffe4e5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa82bddf9aa0455797d42993fe850ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0917b2a75df4a9ab1d2cbd4fd3f7613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:49.806481 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4d22bab0-8b15-498c-8e6a-55b26dffe4e5 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 200 len: 1612 microversion: 2.1 time: 0.093569 Jul 21 17:55:49.807065 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 503/1013] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:49 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 1612 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:55:49.976914 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-b4b9c00d-9d1a-41d3-b71e-cacea869dd0f req-a0b26aa0-da40-4b99-8e39-b5a7272aa590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2e5488-2d1e-4068-879f-7ceba9b9f06c", "name": "network-vif-deleted", "tag": "c146c9f3-9d7c-4fc3-8dd4-0187175d73bb"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:55:49.986819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-b4b9c00d-9d1a-41d3-b71e-cacea869dd0f req-a0b26aa0-da40-4b99-8e39-b5a7272aa590 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:49.987269 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-b4b9c00d-9d1a-41d3-b71e-cacea869dd0f req-a0b26aa0-da40-4b99-8e39-b5a7272aa590 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:49.999759 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-b4b9c00d-9d1a-41d3-b71e-cacea869dd0f req-a0b26aa0-da40-4b99-8e39-b5a7272aa590 service nova] Creating event network-vif-deleted:c146c9f3-9d7c-4fc3-8dd4-0187175d73bb for instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c on hv-cinder-82549 Jul 21 17:55:50.005673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-b4b9c00d-9d1a-41d3-b71e-cacea869dd0f req-a0b26aa0-da40-4b99-8e39-b5a7272aa590 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032991 Jul 21 17:55:50.006387 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 511/1014] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:55:50.824981 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-342b9295-d0f9-402f-9998-e6fd9067984a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:50.825607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-342b9295-d0f9-402f-9998-e6fd9067984a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:50.832475 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-342b9295-d0f9-402f-9998-e6fd9067984a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:50.832943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-342b9295-d0f9-402f-9998-e6fd9067984a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:50.833737 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-342b9295-d0f9-402f-9998-e6fd9067984a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:50.834182 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-342b9295-d0f9-402f-9998-e6fd9067984a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:50.849182 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-342b9295-d0f9-402f-9998-e6fd9067984a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] HTTP exception thrown: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-342b9295-d0f9-402f-9998-e6fd9067984a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Request method failure captured: Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c HTTP/1.1 Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y4MLMBby9pVb6fwZuBjDRRu9HKRFu1ubjEDLV-WnX1WKQKVX_XMZ4Yqw6FkUH0RRqITWcDICF4pmsesAnL59Rfd9lRL-u5FtRZh9LwiE1kZl5RReoX0EElUgVwXfWiOqjbNCaVPpfluVfKkWpY7Bs2i6epWgLEEnsNP5LGqfJDuT0g Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 17:55:50.850849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 17:55:50.852424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0917b2a75df4a9ab1d2cbd4fd3f7613", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}] Jul 21 17:55:50.852424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 17:55:50.852424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 17:55:50.852424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 17:55:50.852424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 17:55:50.852424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 17:55:50.852424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 17:55:50.852424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: fa82bddf9aa0455797d42993fe850ccf Jul 21 17:55:50.852424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 17:55:50.852424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 17:55:50.852424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 17:55:50.852424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '1b2e5488-2d1e-4068-879f-7ceba9b9f06c'} Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 17:55:50.854049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 17:55:50.855970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 17:55:50.857550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-342b9295-d0f9-402f-9998-e6fd9067984a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Returning 404 to user: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 17:55:50.857550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-342b9295-d0f9-402f-9998-e6fd9067984a tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 404 len: 111 microversion: 2.1 time: 0.031926 Jul 21 17:55:50.857550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 504/1015] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:50 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 17:55:50.862167 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-daa0d598-6713-47cf-8bd0-0ef36c5d2257 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '.version_select at 0x7ffa2a433e50>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:50.882136 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-daa0d598-6713-47cf-8bd0-0ef36c5d2257 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-383806190" status: 202 len: 0 microversion: 2.1 time: 0.024018 Jul 21 17:55:50.882747 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 512/1016] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jul 21 17:55:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-383806190 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 17:55:51.559036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-65eaec13-af61-4604-9e64-671fc7d6d0f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:51.559603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-65eaec13-af61-4604-9e64-671fc7d6d0f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:51.566326 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65eaec13-af61-4604-9e64-671fc7d6d0f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:51.566821 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65eaec13-af61-4604-9e64-671fc7d6d0f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:51.567618 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65eaec13-af61-4604-9e64-671fc7d6d0f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:51.568071 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65eaec13-af61-4604-9e64-671fc7d6d0f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:51.593587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-65eaec13-af61-4604-9e64-671fc7d6d0f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 17:55:51.674315 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-65eaec13-af61-4604-9e64-671fc7d6d0f9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 204 len: 0 microversion: 2.1 time: 0.119477 Jul 21 17:55:51.674903 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 505/1017] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 17:55:51 2022] DELETE /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 17:55:51.683485 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d6d52d20-a0f6-428d-8e3b-186e2ca6d258 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:51.684385 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d6d52d20-a0f6-428d-8e3b-186e2ca6d258 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:51.691497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d6d52d20-a0f6-428d-8e3b-186e2ca6d258 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:51.691946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d6d52d20-a0f6-428d-8e3b-186e2ca6d258 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:51.692745 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d6d52d20-a0f6-428d-8e3b-186e2ca6d258 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:51.693188 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d6d52d20-a0f6-428d-8e3b-186e2ca6d258 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:51.822340 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d6d52d20-a0f6-428d-8e3b-186e2ca6d258 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:51.830819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d6d52d20-a0f6-428d-8e3b-186e2ca6d258 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1720 microversion: 2.1 time: 0.151684 Jul 21 17:55:51.831379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 513/1018] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:55:52.849055 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ef195c60-f578-4fbd-8ecd-e10a0e8bbb03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:52.849902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ef195c60-f578-4fbd-8ecd-e10a0e8bbb03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:52.858361 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef195c60-f578-4fbd-8ecd-e10a0e8bbb03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:52.858855 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef195c60-f578-4fbd-8ecd-e10a0e8bbb03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:52.859639 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef195c60-f578-4fbd-8ecd-e10a0e8bbb03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:52.860080 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef195c60-f578-4fbd-8ecd-e10a0e8bbb03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:53.014792 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ef195c60-f578-4fbd-8ecd-e10a0e8bbb03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:53.023207 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ef195c60-f578-4fbd-8ecd-e10a0e8bbb03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1720 microversion: 2.1 time: 0.178410 Jul 21 17:55:53.033726 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 506/1019] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:52 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:55:53.460901 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-868e8359-68cd-490b-b47e-f0fd9348f533 req-a29087ac-3d97-4199-b320-cde489b65d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff28a98-a8bf-43c7-ad64-2b693c0d419e", "name": "network-vif-deleted", "tag": "79e6e077-66c3-4d54-9164-1c97dd9c881c"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:55:53.472190 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-868e8359-68cd-490b-b47e-f0fd9348f533 req-a29087ac-3d97-4199-b320-cde489b65d96 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:53.472696 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-868e8359-68cd-490b-b47e-f0fd9348f533 req-a29087ac-3d97-4199-b320-cde489b65d96 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:53.488032 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-868e8359-68cd-490b-b47e-f0fd9348f533 req-a29087ac-3d97-4199-b320-cde489b65d96 service nova] Creating event network-vif-deleted:79e6e077-66c3-4d54-9164-1c97dd9c881c for instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e on hv-cinder-82549 Jul 21 17:55:53.494290 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-868e8359-68cd-490b-b47e-f0fd9348f533 req-a29087ac-3d97-4199-b320-cde489b65d96 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037202 Jul 21 17:55:53.494894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 514/1020] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:55:54.041239 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d1987d4b-1974-4b30-a65f-c0e48b0a7b3a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:54.041872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d1987d4b-1974-4b30-a65f-c0e48b0a7b3a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:54.049352 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1987d4b-1974-4b30-a65f-c0e48b0a7b3a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:54.049814 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1987d4b-1974-4b30-a65f-c0e48b0a7b3a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:54.050598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1987d4b-1974-4b30-a65f-c0e48b0a7b3a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:54.051041 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1987d4b-1974-4b30-a65f-c0e48b0a7b3a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:54.116150 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d1987d4b-1974-4b30-a65f-c0e48b0a7b3a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:54.125584 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d1987d4b-1974-4b30-a65f-c0e48b0a7b3a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.088227 Jul 21 17:55:54.126153 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 507/1021] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:54 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:55:55.143509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ceb2ecd5-720c-464d-a50c-39e584600c32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:55.144208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ceb2ecd5-720c-464d-a50c-39e584600c32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:55.150918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ceb2ecd5-720c-464d-a50c-39e584600c32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:55.151402 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ceb2ecd5-720c-464d-a50c-39e584600c32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:55.152134 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ceb2ecd5-720c-464d-a50c-39e584600c32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:55.152604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ceb2ecd5-720c-464d-a50c-39e584600c32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:55.214576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ceb2ecd5-720c-464d-a50c-39e584600c32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:55.222326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ceb2ecd5-720c-464d-a50c-39e584600c32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083047 Jul 21 17:55:55.222881 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 515/1022] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:55 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:55:56.238952 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b6164a25-bb29-45bd-8b99-688eece5ea53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:56.239510 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b6164a25-bb29-45bd-8b99-688eece5ea53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:56.245917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b6164a25-bb29-45bd-8b99-688eece5ea53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:56.246364 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b6164a25-bb29-45bd-8b99-688eece5ea53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:56.247128 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b6164a25-bb29-45bd-8b99-688eece5ea53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:56.247563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b6164a25-bb29-45bd-8b99-688eece5ea53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:56.310797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b6164a25-bb29-45bd-8b99-688eece5ea53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:56.319068 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b6164a25-bb29-45bd-8b99-688eece5ea53 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084012 Jul 21 17:55:56.319620 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 508/1023] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:56 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:55:57.337188 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6d5161dd-7d66-4b0f-bcd7-a0f0615bb01b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:57.337739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6d5161dd-7d66-4b0f-bcd7-a0f0615bb01b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:57.344681 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d5161dd-7d66-4b0f-bcd7-a0f0615bb01b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:57.345137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d5161dd-7d66-4b0f-bcd7-a0f0615bb01b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:57.345910 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d5161dd-7d66-4b0f-bcd7-a0f0615bb01b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:57.346356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d5161dd-7d66-4b0f-bcd7-a0f0615bb01b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:57.408042 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6d5161dd-7d66-4b0f-bcd7-a0f0615bb01b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:57.415892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6d5161dd-7d66-4b0f-bcd7-a0f0615bb01b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082794 Jul 21 17:55:57.416475 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 516/1024] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:57 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:55:58.432597 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-69d60c36-9823-4974-b9e8-2875b3ddafa6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:58.433213 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-69d60c36-9823-4974-b9e8-2875b3ddafa6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:58.440620 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-69d60c36-9823-4974-b9e8-2875b3ddafa6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:58.441069 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-69d60c36-9823-4974-b9e8-2875b3ddafa6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:58.441825 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-69d60c36-9823-4974-b9e8-2875b3ddafa6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:58.442262 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-69d60c36-9823-4974-b9e8-2875b3ddafa6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:58.502487 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-69d60c36-9823-4974-b9e8-2875b3ddafa6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:58.510442 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-69d60c36-9823-4974-b9e8-2875b3ddafa6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081720 Jul 21 17:55:58.511004 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 509/1025] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:58 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:55:59.527348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-06cec76b-05cb-4390-b2e9-20c3d8c45e81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:55:59.528744 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-06cec76b-05cb-4390-b2e9-20c3d8c45e81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:55:59.535453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-06cec76b-05cb-4390-b2e9-20c3d8c45e81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:59.535903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-06cec76b-05cb-4390-b2e9-20c3d8c45e81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:59.536689 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-06cec76b-05cb-4390-b2e9-20c3d8c45e81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:55:59.537125 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-06cec76b-05cb-4390-b2e9-20c3d8c45e81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:55:59.598451 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-06cec76b-05cb-4390-b2e9-20c3d8c45e81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:55:59.607181 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-06cec76b-05cb-4390-b2e9-20c3d8c45e81 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083746 Jul 21 17:55:59.607737 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 517/1026] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:55:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:00.623463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-007b4194-0544-4a5e-827f-b830fa8983ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:00.624066 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-007b4194-0544-4a5e-827f-b830fa8983ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:00.630611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-007b4194-0544-4a5e-827f-b830fa8983ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:00.631065 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-007b4194-0544-4a5e-827f-b830fa8983ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:00.631820 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-007b4194-0544-4a5e-827f-b830fa8983ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:00.632287 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-007b4194-0544-4a5e-827f-b830fa8983ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:00.695411 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-007b4194-0544-4a5e-827f-b830fa8983ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:00.703634 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-007b4194-0544-4a5e-827f-b830fa8983ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084569 Jul 21 17:56:00.704222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 510/1027] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:01.720722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9334d8f1-5373-483c-9ce7-bb97827eb21c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:01.721325 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9334d8f1-5373-483c-9ce7-bb97827eb21c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:01.727392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9334d8f1-5373-483c-9ce7-bb97827eb21c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:01.727836 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9334d8f1-5373-483c-9ce7-bb97827eb21c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:01.728629 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9334d8f1-5373-483c-9ce7-bb97827eb21c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:01.729064 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9334d8f1-5373-483c-9ce7-bb97827eb21c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:01.789512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9334d8f1-5373-483c-9ce7-bb97827eb21c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:01.799070 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9334d8f1-5373-483c-9ce7-bb97827eb21c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082199 Jul 21 17:56:01.799638 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 518/1028] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:01 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:56:02.816533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7d507b92-b4aa-48ae-8c2b-70efe4b2d839 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:02.817153 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7d507b92-b4aa-48ae-8c2b-70efe4b2d839 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:02.823493 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d507b92-b4aa-48ae-8c2b-70efe4b2d839 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:02.823987 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d507b92-b4aa-48ae-8c2b-70efe4b2d839 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:02.825420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d507b92-b4aa-48ae-8c2b-70efe4b2d839 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:02.825870 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d507b92-b4aa-48ae-8c2b-70efe4b2d839 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:02.887918 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7d507b92-b4aa-48ae-8c2b-70efe4b2d839 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:02.895912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7d507b92-b4aa-48ae-8c2b-70efe4b2d839 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083652 Jul 21 17:56:02.896493 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 511/1029] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:03.912628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fcc4217c-0bfd-43f4-872b-3941236fb929 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:03.913307 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fcc4217c-0bfd-43f4-872b-3941236fb929 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:03.919998 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fcc4217c-0bfd-43f4-872b-3941236fb929 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:03.920477 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fcc4217c-0bfd-43f4-872b-3941236fb929 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:03.921242 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fcc4217c-0bfd-43f4-872b-3941236fb929 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:03.921674 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fcc4217c-0bfd-43f4-872b-3941236fb929 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:03.984428 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-fcc4217c-0bfd-43f4-872b-3941236fb929 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:03.992283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fcc4217c-0bfd-43f4-872b-3941236fb929 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083493 Jul 21 17:56:03.992865 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 519/1030] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:03 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:05.009855 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-02fae854-1bbf-472b-b66d-6980ada3b744 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:05.010480 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-02fae854-1bbf-472b-b66d-6980ada3b744 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:05.018720 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02fae854-1bbf-472b-b66d-6980ada3b744 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:05.019400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02fae854-1bbf-472b-b66d-6980ada3b744 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:05.020859 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02fae854-1bbf-472b-b66d-6980ada3b744 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:05.021400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02fae854-1bbf-472b-b66d-6980ada3b744 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:05.086987 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-02fae854-1bbf-472b-b66d-6980ada3b744 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:05.095675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-02fae854-1bbf-472b-b66d-6980ada3b744 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.089690 Jul 21 17:56:05.096241 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 512/1031] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:56:06.112463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2eb1d17a-0870-40f4-b6be-d7906cddb628 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:06.112998 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2eb1d17a-0870-40f4-b6be-d7906cddb628 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:06.119529 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2eb1d17a-0870-40f4-b6be-d7906cddb628 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:06.119983 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2eb1d17a-0870-40f4-b6be-d7906cddb628 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:06.120774 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2eb1d17a-0870-40f4-b6be-d7906cddb628 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:06.121212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2eb1d17a-0870-40f4-b6be-d7906cddb628 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:06.182588 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2eb1d17a-0870-40f4-b6be-d7906cddb628 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:06.191782 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2eb1d17a-0870-40f4-b6be-d7906cddb628 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083364 Jul 21 17:56:06.192368 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 520/1032] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:06 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:07.209115 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-76510f3d-fcee-400f-9f26-e6ed1d14efda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:07.209688 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-76510f3d-fcee-400f-9f26-e6ed1d14efda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:07.216196 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76510f3d-fcee-400f-9f26-e6ed1d14efda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:07.216697 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76510f3d-fcee-400f-9f26-e6ed1d14efda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:07.217473 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76510f3d-fcee-400f-9f26-e6ed1d14efda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:07.217921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76510f3d-fcee-400f-9f26-e6ed1d14efda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:07.279225 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-76510f3d-fcee-400f-9f26-e6ed1d14efda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:07.287196 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-76510f3d-fcee-400f-9f26-e6ed1d14efda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082038 Jul 21 17:56:07.287771 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 513/1033] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:07 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:08.304659 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3a8dcd1a-ba41-47cf-9e16-64fb8b897bd9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:08.305809 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3a8dcd1a-ba41-47cf-9e16-64fb8b897bd9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:08.312505 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a8dcd1a-ba41-47cf-9e16-64fb8b897bd9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:08.312956 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a8dcd1a-ba41-47cf-9e16-64fb8b897bd9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:08.313724 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a8dcd1a-ba41-47cf-9e16-64fb8b897bd9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:08.314162 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a8dcd1a-ba41-47cf-9e16-64fb8b897bd9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:08.376962 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3a8dcd1a-ba41-47cf-9e16-64fb8b897bd9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:08.384925 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3a8dcd1a-ba41-47cf-9e16-64fb8b897bd9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084206 Jul 21 17:56:08.385484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 521/1034] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:09.402465 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-31962620-c045-4a68-901d-c0d6e70f699e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:09.403644 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-31962620-c045-4a68-901d-c0d6e70f699e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:09.410708 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-31962620-c045-4a68-901d-c0d6e70f699e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:09.411173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-31962620-c045-4a68-901d-c0d6e70f699e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:09.411950 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-31962620-c045-4a68-901d-c0d6e70f699e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:09.412423 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-31962620-c045-4a68-901d-c0d6e70f699e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:09.477991 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-31962620-c045-4a68-901d-c0d6e70f699e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:09.486626 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-31962620-c045-4a68-901d-c0d6e70f699e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.088119 Jul 21 17:56:09.487221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 514/1035] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:10.503986 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a99bd6c3-792c-46f2-a1b2-2267e62aa673 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:10.504614 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a99bd6c3-792c-46f2-a1b2-2267e62aa673 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:10.511369 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a99bd6c3-792c-46f2-a1b2-2267e62aa673 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:10.511821 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a99bd6c3-792c-46f2-a1b2-2267e62aa673 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:10.512776 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a99bd6c3-792c-46f2-a1b2-2267e62aa673 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:10.513389 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a99bd6c3-792c-46f2-a1b2-2267e62aa673 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:10.575211 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a99bd6c3-792c-46f2-a1b2-2267e62aa673 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:10.583133 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a99bd6c3-792c-46f2-a1b2-2267e62aa673 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083033 Jul 21 17:56:10.583687 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 522/1036] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:10 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:11.600038 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-84ebe292-b804-417c-91bd-49df72d8dda9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:11.600599 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-84ebe292-b804-417c-91bd-49df72d8dda9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:11.607319 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84ebe292-b804-417c-91bd-49df72d8dda9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:11.607766 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84ebe292-b804-417c-91bd-49df72d8dda9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:11.608561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84ebe292-b804-417c-91bd-49df72d8dda9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:11.608998 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84ebe292-b804-417c-91bd-49df72d8dda9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:11.673835 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-84ebe292-b804-417c-91bd-49df72d8dda9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:11.677364 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:56:11.682844 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-84ebe292-b804-417c-91bd-49df72d8dda9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086809 Jul 21 17:56:11.683400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 515/1037] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:11 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:12.576168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cbaacb7c-36b6-48ed-9b06-cc6649ff2c85 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:12.576822 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cbaacb7c-36b6-48ed-9b06-cc6649ff2c85 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:12.583458 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cbaacb7c-36b6-48ed-9b06-cc6649ff2c85 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:12.583902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cbaacb7c-36b6-48ed-9b06-cc6649ff2c85 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:12.584692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cbaacb7c-36b6-48ed-9b06-cc6649ff2c85 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:12.585127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cbaacb7c-36b6-48ed-9b06-cc6649ff2c85 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:12.607882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cbaacb7c-36b6-48ed-9b06-cc6649ff2c85 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807/ips" status: 200 len: 151 microversion: 2.20 time: 0.050744 Jul 21 17:56:12.608454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 523/1038] 10.222.0.57 () {60 vars in 1288 bytes} [Thu Jul 21 17:56:12 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 17:56:12.701364 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-efccd932-9ae0-4ac9-9210-aecf232f4740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:12.701979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-efccd932-9ae0-4ac9-9210-aecf232f4740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:12.709151 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efccd932-9ae0-4ac9-9210-aecf232f4740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:12.709633 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efccd932-9ae0-4ac9-9210-aecf232f4740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:12.710425 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efccd932-9ae0-4ac9-9210-aecf232f4740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:12.710861 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efccd932-9ae0-4ac9-9210-aecf232f4740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:12.773399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-efccd932-9ae0-4ac9-9210-aecf232f4740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:12.781740 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-efccd932-9ae0-4ac9-9210-aecf232f4740 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085172 Jul 21 17:56:12.782300 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 516/1039] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:12 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:13.798713 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4704f24c-1dd6-4bd3-a2c0-713ebb41f903 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:13.799238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4704f24c-1dd6-4bd3-a2c0-713ebb41f903 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:13.805659 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4704f24c-1dd6-4bd3-a2c0-713ebb41f903 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:13.806106 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4704f24c-1dd6-4bd3-a2c0-713ebb41f903 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:13.806858 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4704f24c-1dd6-4bd3-a2c0-713ebb41f903 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:13.807298 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4704f24c-1dd6-4bd3-a2c0-713ebb41f903 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:13.870550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4704f24c-1dd6-4bd3-a2c0-713ebb41f903 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:13.878458 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4704f24c-1dd6-4bd3-a2c0-713ebb41f903 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084254 Jul 21 17:56:13.879012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 524/1040] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:56:14.895049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0731c04c-799a-404a-a693-e3c3765dc294 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:14.895625 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0731c04c-799a-404a-a693-e3c3765dc294 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:14.902208 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0731c04c-799a-404a-a693-e3c3765dc294 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:14.902667 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0731c04c-799a-404a-a693-e3c3765dc294 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:14.903434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0731c04c-799a-404a-a693-e3c3765dc294 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:14.903881 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0731c04c-799a-404a-a693-e3c3765dc294 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:14.965804 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0731c04c-799a-404a-a693-e3c3765dc294 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:14.973935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0731c04c-799a-404a-a693-e3c3765dc294 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082824 Jul 21 17:56:14.974499 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 517/1041] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:14 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:15.991006 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4007cc26-b4cd-4839-b5cb-5116996c3523 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:15.991626 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4007cc26-b4cd-4839-b5cb-5116996c3523 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:15.998833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4007cc26-b4cd-4839-b5cb-5116996c3523 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:15.999624 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4007cc26-b4cd-4839-b5cb-5116996c3523 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:16.000670 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4007cc26-b4cd-4839-b5cb-5116996c3523 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:16.001119 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4007cc26-b4cd-4839-b5cb-5116996c3523 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:16.061763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4007cc26-b4cd-4839-b5cb-5116996c3523 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:16.070161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4007cc26-b4cd-4839-b5cb-5116996c3523 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083015 Jul 21 17:56:16.070723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 525/1042] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:17.087713 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9b4ec5d9-8668-4159-b153-64248554095d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:17.088347 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9b4ec5d9-8668-4159-b153-64248554095d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:17.096067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b4ec5d9-8668-4159-b153-64248554095d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:17.096554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b4ec5d9-8668-4159-b153-64248554095d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:17.097332 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b4ec5d9-8668-4159-b153-64248554095d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:17.097773 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9b4ec5d9-8668-4159-b153-64248554095d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:17.162590 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9b4ec5d9-8668-4159-b153-64248554095d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:17.170906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9b4ec5d9-8668-4159-b153-64248554095d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086923 Jul 21 17:56:17.171467 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 518/1043] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:17 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:18.187768 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0e8ce3e9-9cc1-45c3-ad6f-7499af935df4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:18.188396 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0e8ce3e9-9cc1-45c3-ad6f-7499af935df4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:18.195456 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0e8ce3e9-9cc1-45c3-ad6f-7499af935df4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:18.195900 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0e8ce3e9-9cc1-45c3-ad6f-7499af935df4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:18.196682 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0e8ce3e9-9cc1-45c3-ad6f-7499af935df4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:18.197115 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0e8ce3e9-9cc1-45c3-ad6f-7499af935df4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:18.263365 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0e8ce3e9-9cc1-45c3-ad6f-7499af935df4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:18.271562 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0e8ce3e9-9cc1-45c3-ad6f-7499af935df4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087656 Jul 21 17:56:18.272124 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 526/1044] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:18 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:19.288940 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b36cedf9-8690-41b9-b05f-19cfa4d066ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:19.289505 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b36cedf9-8690-41b9-b05f-19cfa4d066ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:19.291739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:56:19.297690 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b36cedf9-8690-41b9-b05f-19cfa4d066ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:19.298138 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b36cedf9-8690-41b9-b05f-19cfa4d066ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:19.298898 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b36cedf9-8690-41b9-b05f-19cfa4d066ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:19.299333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b36cedf9-8690-41b9-b05f-19cfa4d066ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:19.361399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b36cedf9-8690-41b9-b05f-19cfa4d066ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:19.369144 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b36cedf9-8690-41b9-b05f-19cfa4d066ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084239 Jul 21 17:56:19.369696 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 519/1045] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:19 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:20.386774 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b13b4f9b-8ac9-4c56-b8e8-3d8e8c2140eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:20.387414 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b13b4f9b-8ac9-4c56-b8e8-3d8e8c2140eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:20.390528 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:56:20.395997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b13b4f9b-8ac9-4c56-b8e8-3d8e8c2140eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:20.396484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b13b4f9b-8ac9-4c56-b8e8-3d8e8c2140eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:20.397302 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b13b4f9b-8ac9-4c56-b8e8-3d8e8c2140eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:20.397692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b13b4f9b-8ac9-4c56-b8e8-3d8e8c2140eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:20.401307 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=87 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:56:20.461173 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b13b4f9b-8ac9-4c56-b8e8-3d8e8c2140eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:20.469104 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b13b4f9b-8ac9-4c56-b8e8-3d8e8c2140eb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086141 Jul 21 17:56:20.469659 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 527/1046] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:20 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:21.485724 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cd3a5374-93e0-4073-91aa-8caaf680972d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:21.486312 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cd3a5374-93e0-4073-91aa-8caaf680972d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:21.492909 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd3a5374-93e0-4073-91aa-8caaf680972d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:21.493357 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd3a5374-93e0-4073-91aa-8caaf680972d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:21.494117 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd3a5374-93e0-4073-91aa-8caaf680972d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:21.494553 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd3a5374-93e0-4073-91aa-8caaf680972d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:21.558722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cd3a5374-93e0-4073-91aa-8caaf680972d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:21.567168 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cd3a5374-93e0-4073-91aa-8caaf680972d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085928 Jul 21 17:56:21.567736 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 520/1047] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:22.584072 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-71179396-8cfd-4442-ac4e-4c184cd374b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:22.584697 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-71179396-8cfd-4442-ac4e-4c184cd374b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:22.591264 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-71179396-8cfd-4442-ac4e-4c184cd374b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:22.591709 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-71179396-8cfd-4442-ac4e-4c184cd374b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:22.592491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-71179396-8cfd-4442-ac4e-4c184cd374b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:22.592927 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-71179396-8cfd-4442-ac4e-4c184cd374b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:22.658076 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-71179396-8cfd-4442-ac4e-4c184cd374b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:22.665962 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-71179396-8cfd-4442-ac4e-4c184cd374b7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085787 Jul 21 17:56:22.666520 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 528/1048] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:22 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:23.682820 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-288392bc-beb2-4d57-a4a7-ab96eb8157c9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:23.683467 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-288392bc-beb2-4d57-a4a7-ab96eb8157c9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:23.690910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-288392bc-beb2-4d57-a4a7-ab96eb8157c9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:23.691531 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-288392bc-beb2-4d57-a4a7-ab96eb8157c9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:23.692314 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-288392bc-beb2-4d57-a4a7-ab96eb8157c9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:23.692754 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-288392bc-beb2-4d57-a4a7-ab96eb8157c9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:23.752331 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-288392bc-beb2-4d57-a4a7-ab96eb8157c9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:23.760973 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-288392bc-beb2-4d57-a4a7-ab96eb8157c9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081915 Jul 21 17:56:23.761536 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 521/1049] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:23 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:24.777980 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2073f195-1e73-4922-8980-ebd9315df2cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:24.778608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2073f195-1e73-4922-8980-ebd9315df2cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:24.786986 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2073f195-1e73-4922-8980-ebd9315df2cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:24.786986 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2073f195-1e73-4922-8980-ebd9315df2cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:24.787491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2073f195-1e73-4922-8980-ebd9315df2cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:24.787921 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2073f195-1e73-4922-8980-ebd9315df2cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:24.853210 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2073f195-1e73-4922-8980-ebd9315df2cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:24.861107 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2073f195-1e73-4922-8980-ebd9315df2cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087011 Jul 21 17:56:24.861662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 529/1050] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:24 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:25.878329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-513f47dd-2901-48f2-9663-9f007883788c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:25.878939 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-513f47dd-2901-48f2-9663-9f007883788c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:25.885544 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-513f47dd-2901-48f2-9663-9f007883788c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:25.885996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-513f47dd-2901-48f2-9663-9f007883788c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:25.886770 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-513f47dd-2901-48f2-9663-9f007883788c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:25.887210 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-513f47dd-2901-48f2-9663-9f007883788c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:25.948906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-513f47dd-2901-48f2-9663-9f007883788c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:25.957774 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-513f47dd-2901-48f2-9663-9f007883788c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083399 Jul 21 17:56:25.958337 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 522/1051] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:25 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:26.974547 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2a86cb2d-de6d-4ca1-b092-d0425aee27f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:26.975155 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2a86cb2d-de6d-4ca1-b092-d0425aee27f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:26.981610 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2a86cb2d-de6d-4ca1-b092-d0425aee27f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:26.982068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2a86cb2d-de6d-4ca1-b092-d0425aee27f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:26.982824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2a86cb2d-de6d-4ca1-b092-d0425aee27f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:26.983255 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2a86cb2d-de6d-4ca1-b092-d0425aee27f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:27.047266 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2a86cb2d-de6d-4ca1-b092-d0425aee27f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:27.055962 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2a86cb2d-de6d-4ca1-b092-d0425aee27f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085235 Jul 21 17:56:27.056556 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 530/1052] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:26 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:28.073096 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4e3bc170-6b0e-4042-8687-c4050af40009 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:28.073714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4e3bc170-6b0e-4042-8687-c4050af40009 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:28.080156 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e3bc170-6b0e-4042-8687-c4050af40009 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:28.081304 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e3bc170-6b0e-4042-8687-c4050af40009 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:28.082179 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e3bc170-6b0e-4042-8687-c4050af40009 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:28.082619 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e3bc170-6b0e-4042-8687-c4050af40009 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:28.145119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4e3bc170-6b0e-4042-8687-c4050af40009 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:28.153074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4e3bc170-6b0e-4042-8687-c4050af40009 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083935 Jul 21 17:56:28.153637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 523/1053] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:28 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:29.170147 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2244a19b-c363-4e27-a289-6f17ffaed4d6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:29.170767 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2244a19b-c363-4e27-a289-6f17ffaed4d6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:29.177739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2244a19b-c363-4e27-a289-6f17ffaed4d6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:29.178197 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2244a19b-c363-4e27-a289-6f17ffaed4d6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:29.178970 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2244a19b-c363-4e27-a289-6f17ffaed4d6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:29.179414 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2244a19b-c363-4e27-a289-6f17ffaed4d6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:29.241386 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2244a19b-c363-4e27-a289-6f17ffaed4d6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:29.249283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2244a19b-c363-4e27-a289-6f17ffaed4d6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082972 Jul 21 17:56:29.249836 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 531/1054] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:29 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:30.266329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0486c5e5-c5c3-4f97-a582-a08d71d5deb7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:30.266928 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0486c5e5-c5c3-4f97-a582-a08d71d5deb7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:30.273474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0486c5e5-c5c3-4f97-a582-a08d71d5deb7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:30.273932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0486c5e5-c5c3-4f97-a582-a08d71d5deb7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:30.274710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0486c5e5-c5c3-4f97-a582-a08d71d5deb7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:30.275155 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0486c5e5-c5c3-4f97-a582-a08d71d5deb7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:30.335925 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0486c5e5-c5c3-4f97-a582-a08d71d5deb7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:30.343862 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0486c5e5-c5c3-4f97-a582-a08d71d5deb7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081577 Jul 21 17:56:30.344457 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 524/1055] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:30 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:31.361306 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bc25895e-d817-44f4-9969-66d37ee7b4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:31.362548 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bc25895e-d817-44f4-9969-66d37ee7b4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:31.368713 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc25895e-d817-44f4-9969-66d37ee7b4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:31.369173 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc25895e-d817-44f4-9969-66d37ee7b4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:31.369951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc25895e-d817-44f4-9969-66d37ee7b4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:31.370393 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc25895e-d817-44f4-9969-66d37ee7b4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:31.432714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-bc25895e-d817-44f4-9969-66d37ee7b4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:31.441820 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bc25895e-d817-44f4-9969-66d37ee7b4a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084603 Jul 21 17:56:31.442391 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 532/1056] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:32.459517 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c1ef8b3f-3c42-435c-bf4c-65d2b276bb4f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:32.460137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c1ef8b3f-3c42-435c-bf4c-65d2b276bb4f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:32.466249 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1ef8b3f-3c42-435c-bf4c-65d2b276bb4f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:32.466701 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1ef8b3f-3c42-435c-bf4c-65d2b276bb4f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:32.467459 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1ef8b3f-3c42-435c-bf4c-65d2b276bb4f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:32.467896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1ef8b3f-3c42-435c-bf4c-65d2b276bb4f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:32.527592 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c1ef8b3f-3c42-435c-bf4c-65d2b276bb4f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:32.535681 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c1ef8b3f-3c42-435c-bf4c-65d2b276bb4f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.080972 Jul 21 17:56:32.536233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 525/1057] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:32 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:33.552848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-73ded98e-afe4-4103-ae27-52b16b1bb295 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:33.553487 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-73ded98e-afe4-4103-ae27-52b16b1bb295 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:33.560038 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-73ded98e-afe4-4103-ae27-52b16b1bb295 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:33.560527 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-73ded98e-afe4-4103-ae27-52b16b1bb295 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:33.561283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-73ded98e-afe4-4103-ae27-52b16b1bb295 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:33.561716 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-73ded98e-afe4-4103-ae27-52b16b1bb295 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:33.622414 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-73ded98e-afe4-4103-ae27-52b16b1bb295 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:33.630342 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-73ded98e-afe4-4103-ae27-52b16b1bb295 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081419 Jul 21 17:56:33.630909 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 533/1058] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:33 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:34.647616 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c4e988ef-2bbd-4d62-8bcd-e8244f8f6c9b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:34.648233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c4e988ef-2bbd-4d62-8bcd-e8244f8f6c9b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:34.655149 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c4e988ef-2bbd-4d62-8bcd-e8244f8f6c9b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:34.655647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c4e988ef-2bbd-4d62-8bcd-e8244f8f6c9b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:34.656514 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c4e988ef-2bbd-4d62-8bcd-e8244f8f6c9b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:34.656994 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c4e988ef-2bbd-4d62-8bcd-e8244f8f6c9b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:34.718293 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c4e988ef-2bbd-4d62-8bcd-e8244f8f6c9b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:34.726470 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c4e988ef-2bbd-4d62-8bcd-e8244f8f6c9b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083420 Jul 21 17:56:34.727030 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 526/1059] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:34 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:35.742869 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-130f2f21-3957-4aff-b36b-fa3cce9b697c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:35.743466 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-130f2f21-3957-4aff-b36b-fa3cce9b697c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:35.749992 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-130f2f21-3957-4aff-b36b-fa3cce9b697c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:35.750446 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-130f2f21-3957-4aff-b36b-fa3cce9b697c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:35.751208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-130f2f21-3957-4aff-b36b-fa3cce9b697c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:35.751646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-130f2f21-3957-4aff-b36b-fa3cce9b697c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:35.815633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-130f2f21-3957-4aff-b36b-fa3cce9b697c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:35.823546 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-130f2f21-3957-4aff-b36b-fa3cce9b697c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084539 Jul 21 17:56:35.824109 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 534/1060] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:35 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:36.840854 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3168be90-fb9c-40ae-8270-6eb9a194d96e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:36.841378 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3168be90-fb9c-40ae-8270-6eb9a194d96e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:36.848555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3168be90-fb9c-40ae-8270-6eb9a194d96e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:36.849011 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3168be90-fb9c-40ae-8270-6eb9a194d96e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:36.850177 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3168be90-fb9c-40ae-8270-6eb9a194d96e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:36.850604 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3168be90-fb9c-40ae-8270-6eb9a194d96e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:36.914178 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3168be90-fb9c-40ae-8270-6eb9a194d96e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:36.922292 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3168be90-fb9c-40ae-8270-6eb9a194d96e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085388 Jul 21 17:56:36.922857 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 527/1061] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:36 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:37.939056 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-354fc6a0-d978-4fb3-88a9-1073e815ac18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:37.939928 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-354fc6a0-d978-4fb3-88a9-1073e815ac18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:37.947779 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-354fc6a0-d978-4fb3-88a9-1073e815ac18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:37.948234 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-354fc6a0-d978-4fb3-88a9-1073e815ac18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:37.949033 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-354fc6a0-d978-4fb3-88a9-1073e815ac18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:37.949475 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-354fc6a0-d978-4fb3-88a9-1073e815ac18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:38.013518 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-354fc6a0-d978-4fb3-88a9-1073e815ac18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:38.022063 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-354fc6a0-d978-4fb3-88a9-1073e815ac18 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086981 Jul 21 17:56:38.022632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 535/1062] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:37 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:39.039933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4e5ff213-7a4e-4f92-b06c-8d3ffca741c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:39.040630 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4e5ff213-7a4e-4f92-b06c-8d3ffca741c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:39.047350 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e5ff213-7a4e-4f92-b06c-8d3ffca741c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:39.047807 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e5ff213-7a4e-4f92-b06c-8d3ffca741c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:39.048609 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e5ff213-7a4e-4f92-b06c-8d3ffca741c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:39.049049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4e5ff213-7a4e-4f92-b06c-8d3ffca741c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:39.111381 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4e5ff213-7a4e-4f92-b06c-8d3ffca741c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:39.120167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4e5ff213-7a4e-4f92-b06c-8d3ffca741c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084565 Jul 21 17:56:39.120760 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 528/1063] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:39 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:40.137079 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-902233b3-8612-43bc-a6b7-0167c9b872b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:40.137719 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-902233b3-8612-43bc-a6b7-0167c9b872b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:40.144739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-902233b3-8612-43bc-a6b7-0167c9b872b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:40.145191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-902233b3-8612-43bc-a6b7-0167c9b872b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:40.145947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-902233b3-8612-43bc-a6b7-0167c9b872b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:40.146387 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-902233b3-8612-43bc-a6b7-0167c9b872b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:40.211087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-902233b3-8612-43bc-a6b7-0167c9b872b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:40.219034 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-902233b3-8612-43bc-a6b7-0167c9b872b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085832 Jul 21 17:56:40.219595 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 536/1064] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:41.237108 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fc2602bb-394c-4696-8282-4021d9dae21f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:41.238599 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fc2602bb-394c-4696-8282-4021d9dae21f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:41.244948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fc2602bb-394c-4696-8282-4021d9dae21f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:41.245396 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fc2602bb-394c-4696-8282-4021d9dae21f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:41.246155 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fc2602bb-394c-4696-8282-4021d9dae21f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:41.246595 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fc2602bb-394c-4696-8282-4021d9dae21f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:41.309151 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fc2602bb-394c-4696-8282-4021d9dae21f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:41.317901 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fc2602bb-394c-4696-8282-4021d9dae21f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085184 Jul 21 17:56:41.318463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 529/1065] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:41 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:42.335241 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-16064141-2cfc-47d5-9367-5e20b07ded99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:42.335767 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-16064141-2cfc-47d5-9367-5e20b07ded99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:42.342206 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-16064141-2cfc-47d5-9367-5e20b07ded99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:42.342659 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-16064141-2cfc-47d5-9367-5e20b07ded99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:42.343422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-16064141-2cfc-47d5-9367-5e20b07ded99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:42.343858 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-16064141-2cfc-47d5-9367-5e20b07ded99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:42.403551 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-16064141-2cfc-47d5-9367-5e20b07ded99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:42.411342 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-16064141-2cfc-47d5-9367-5e20b07ded99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.080631 Jul 21 17:56:42.411894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 537/1066] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:42 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:43.428014 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dc6adcc0-d3b7-4ab4-8461-056d23b117d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:43.428666 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dc6adcc0-d3b7-4ab4-8461-056d23b117d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:43.435562 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc6adcc0-d3b7-4ab4-8461-056d23b117d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:43.436012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc6adcc0-d3b7-4ab4-8461-056d23b117d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:43.436803 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc6adcc0-d3b7-4ab4-8461-056d23b117d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:43.437242 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc6adcc0-d3b7-4ab4-8461-056d23b117d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:43.441418 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=85 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:56:43.498294 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dc6adcc0-d3b7-4ab4-8461-056d23b117d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:43.507056 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dc6adcc0-d3b7-4ab4-8461-056d23b117d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082913 Jul 21 17:56:43.507621 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 530/1067] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:44.522825 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-30cd566e-cb2f-4a3c-8416-8986c84f1c9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:44.523461 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-30cd566e-cb2f-4a3c-8416-8986c84f1c9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:44.530047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-30cd566e-cb2f-4a3c-8416-8986c84f1c9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:44.530493 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-30cd566e-cb2f-4a3c-8416-8986c84f1c9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:44.531243 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-30cd566e-cb2f-4a3c-8416-8986c84f1c9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:44.531678 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-30cd566e-cb2f-4a3c-8416-8986c84f1c9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:44.597346 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-30cd566e-cb2f-4a3c-8416-8986c84f1c9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:44.605338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-30cd566e-cb2f-4a3c-8416-8986c84f1c9a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086365 Jul 21 17:56:44.605890 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 538/1068] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:44 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:45.623079 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8fc6cd34-0bcb-4518-94bd-dc1214c3b465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:45.623756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8fc6cd34-0bcb-4518-94bd-dc1214c3b465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:45.630837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8fc6cd34-0bcb-4518-94bd-dc1214c3b465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:45.631283 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8fc6cd34-0bcb-4518-94bd-dc1214c3b465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:45.632048 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8fc6cd34-0bcb-4518-94bd-dc1214c3b465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:45.632516 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8fc6cd34-0bcb-4518-94bd-dc1214c3b465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:45.692800 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8fc6cd34-0bcb-4518-94bd-dc1214c3b465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:45.700698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8fc6cd34-0bcb-4518-94bd-dc1214c3b465 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081505 Jul 21 17:56:45.701266 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 531/1069] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:45 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:46.717919 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cb8b9e45-02dc-4d02-bbf3-c2a3840d93e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:46.718511 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cb8b9e45-02dc-4d02-bbf3-c2a3840d93e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:46.725059 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb8b9e45-02dc-4d02-bbf3-c2a3840d93e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:46.725512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb8b9e45-02dc-4d02-bbf3-c2a3840d93e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:46.726275 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb8b9e45-02dc-4d02-bbf3-c2a3840d93e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:46.726714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb8b9e45-02dc-4d02-bbf3-c2a3840d93e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:46.787318 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-cb8b9e45-02dc-4d02-bbf3-c2a3840d93e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:46.795192 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cb8b9e45-02dc-4d02-bbf3-c2a3840d93e1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081126 Jul 21 17:56:46.795745 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 539/1070] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:46 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:47.812081 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b0beda78-0eb4-4684-a2cd-50fea595f314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:47.812744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b0beda78-0eb4-4684-a2cd-50fea595f314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:47.819696 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0beda78-0eb4-4684-a2cd-50fea595f314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:47.820157 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0beda78-0eb4-4684-a2cd-50fea595f314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:47.820981 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0beda78-0eb4-4684-a2cd-50fea595f314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:47.821428 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b0beda78-0eb4-4684-a2cd-50fea595f314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:47.882188 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b0beda78-0eb4-4684-a2cd-50fea595f314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:47.890210 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b0beda78-0eb4-4684-a2cd-50fea595f314 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082043 Jul 21 17:56:47.890794 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 532/1071] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:48.908352 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7bb5c47c-c54c-47b5-9c7f-539985c850bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:48.908905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7bb5c47c-c54c-47b5-9c7f-539985c850bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:48.915968 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7bb5c47c-c54c-47b5-9c7f-539985c850bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:48.916459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7bb5c47c-c54c-47b5-9c7f-539985c850bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:48.917233 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7bb5c47c-c54c-47b5-9c7f-539985c850bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:48.917667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7bb5c47c-c54c-47b5-9c7f-539985c850bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:48.983903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7bb5c47c-c54c-47b5-9c7f-539985c850bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:48.992947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7bb5c47c-c54c-47b5-9c7f-539985c850bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.088571 Jul 21 17:56:48.993504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 540/1072] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:48 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:50.010266 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2fa5fd5b-1db4-46d1-93a2-af1138425129 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:50.010893 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2fa5fd5b-1db4-46d1-93a2-af1138425129 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:50.013247 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=28 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:56:50.019174 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2fa5fd5b-1db4-46d1-93a2-af1138425129 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:50.019638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2fa5fd5b-1db4-46d1-93a2-af1138425129 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:50.020472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2fa5fd5b-1db4-46d1-93a2-af1138425129 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:50.020946 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2fa5fd5b-1db4-46d1-93a2-af1138425129 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:50.082008 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2fa5fd5b-1db4-46d1-93a2-af1138425129 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:50.089967 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2fa5fd5b-1db4-46d1-93a2-af1138425129 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083599 Jul 21 17:56:50.090740 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 533/1073] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:50 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:51.106844 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-aa32832d-2776-4881-9d9e-24f916e87016 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:51.107452 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-aa32832d-2776-4881-9d9e-24f916e87016 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:51.109745 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=28 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:56:51.114984 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aa32832d-2776-4881-9d9e-24f916e87016 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:51.115435 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aa32832d-2776-4881-9d9e-24f916e87016 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:51.116196 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aa32832d-2776-4881-9d9e-24f916e87016 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:51.116656 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-aa32832d-2776-4881-9d9e-24f916e87016 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:51.120979 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=84 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:56:51.180017 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-aa32832d-2776-4881-9d9e-24f916e87016 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:51.187860 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-aa32832d-2776-4881-9d9e-24f916e87016 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084790 Jul 21 17:56:51.188377 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 541/1074] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:52.206552 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e17feceb-dd7f-44ee-8800-317d4bd8e678 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:52.207094 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e17feceb-dd7f-44ee-8800-317d4bd8e678 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:52.213568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e17feceb-dd7f-44ee-8800-317d4bd8e678 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:52.214017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e17feceb-dd7f-44ee-8800-317d4bd8e678 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:52.214781 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e17feceb-dd7f-44ee-8800-317d4bd8e678 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:52.215216 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e17feceb-dd7f-44ee-8800-317d4bd8e678 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:52.278102 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e17feceb-dd7f-44ee-8800-317d4bd8e678 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:52.286639 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e17feceb-dd7f-44ee-8800-317d4bd8e678 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084570 Jul 21 17:56:52.287201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 534/1075] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:52 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:53.304206 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5110fd75-799f-4688-9ac8-15a11073c525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:53.304785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5110fd75-799f-4688-9ac8-15a11073c525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:53.311294 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5110fd75-799f-4688-9ac8-15a11073c525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:53.311744 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5110fd75-799f-4688-9ac8-15a11073c525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:53.312531 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5110fd75-799f-4688-9ac8-15a11073c525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:53.312972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5110fd75-799f-4688-9ac8-15a11073c525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:53.376171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5110fd75-799f-4688-9ac8-15a11073c525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:53.384177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5110fd75-799f-4688-9ac8-15a11073c525 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084792 Jul 21 17:56:53.384773 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 542/1076] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:53 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:54.401174 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-585ec14f-6811-4d8f-9c49-87115a9f72e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:54.401790 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-585ec14f-6811-4d8f-9c49-87115a9f72e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:54.408653 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-585ec14f-6811-4d8f-9c49-87115a9f72e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:54.409358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-585ec14f-6811-4d8f-9c49-87115a9f72e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:54.410152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-585ec14f-6811-4d8f-9c49-87115a9f72e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:54.410590 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-585ec14f-6811-4d8f-9c49-87115a9f72e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:54.471532 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-585ec14f-6811-4d8f-9c49-87115a9f72e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:54.479607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-585ec14f-6811-4d8f-9c49-87115a9f72e9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082583 Jul 21 17:56:54.480169 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 535/1077] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:54 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:56:55.497120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-79feef05-3938-4b28-bba3-175f1725c2b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:55.497716 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-79feef05-3938-4b28-bba3-175f1725c2b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:55.505290 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79feef05-3938-4b28-bba3-175f1725c2b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:55.505743 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79feef05-3938-4b28-bba3-175f1725c2b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:55.506508 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79feef05-3938-4b28-bba3-175f1725c2b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:55.506950 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-79feef05-3938-4b28-bba3-175f1725c2b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:55.568556 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-79feef05-3938-4b28-bba3-175f1725c2b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:55.576704 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-79feef05-3938-4b28-bba3-175f1725c2b3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083154 Jul 21 17:56:55.577266 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 543/1078] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:55 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:56.593826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5d1ab68d-6730-4811-a0d8-0487f540fa56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:56.594443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5d1ab68d-6730-4811-a0d8-0487f540fa56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:56.601815 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5d1ab68d-6730-4811-a0d8-0487f540fa56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:56.602267 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5d1ab68d-6730-4811-a0d8-0487f540fa56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:56.603031 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5d1ab68d-6730-4811-a0d8-0487f540fa56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:56.603478 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5d1ab68d-6730-4811-a0d8-0487f540fa56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:56.665392 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5d1ab68d-6730-4811-a0d8-0487f540fa56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:56.673448 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5d1ab68d-6730-4811-a0d8-0487f540fa56 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083511 Jul 21 17:56:56.674008 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 536/1079] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:56 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:57.690803 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0f47287d-4cb8-41de-b96d-5585263ec821 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:57.692050 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0f47287d-4cb8-41de-b96d-5585263ec821 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:57.698559 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0f47287d-4cb8-41de-b96d-5585263ec821 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:57.699005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0f47287d-4cb8-41de-b96d-5585263ec821 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:57.699758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0f47287d-4cb8-41de-b96d-5585263ec821 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:57.700187 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0f47287d-4cb8-41de-b96d-5585263ec821 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:57.762641 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0f47287d-4cb8-41de-b96d-5585263ec821 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:57.770538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0f47287d-4cb8-41de-b96d-5585263ec821 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083850 Jul 21 17:56:57.771089 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 544/1080] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:57 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:58.787777 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a9326d5c-dbd5-4dd5-a654-75f0f2044776 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:58.788408 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a9326d5c-dbd5-4dd5-a654-75f0f2044776 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:58.794867 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9326d5c-dbd5-4dd5-a654-75f0f2044776 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:58.795314 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9326d5c-dbd5-4dd5-a654-75f0f2044776 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:58.796105 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9326d5c-dbd5-4dd5-a654-75f0f2044776 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:58.796569 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9326d5c-dbd5-4dd5-a654-75f0f2044776 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:58.858080 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a9326d5c-dbd5-4dd5-a654-75f0f2044776 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:58.866036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a9326d5c-dbd5-4dd5-a654-75f0f2044776 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082780 Jul 21 17:56:58.866599 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 537/1081] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:58 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:56:59.890214 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a36c194c-620f-40cb-b9d5-43ad3a24d20e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:56:59.890835 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a36c194c-620f-40cb-b9d5-43ad3a24d20e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:56:59.898441 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a36c194c-620f-40cb-b9d5-43ad3a24d20e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:59.899135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a36c194c-620f-40cb-b9d5-43ad3a24d20e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:59.899951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a36c194c-620f-40cb-b9d5-43ad3a24d20e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:56:59.900458 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a36c194c-620f-40cb-b9d5-43ad3a24d20e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:56:59.969871 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a36c194c-620f-40cb-b9d5-43ad3a24d20e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:56:59.977978 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a36c194c-620f-40cb-b9d5-43ad3a24d20e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.096897 Jul 21 17:56:59.978532 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 545/1082] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:56:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:00.994837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-25c84abe-1ad8-4e57-9d72-ec733e56ca31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:00.995466 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-25c84abe-1ad8-4e57-9d72-ec733e56ca31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:01.001791 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-25c84abe-1ad8-4e57-9d72-ec733e56ca31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:01.002243 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-25c84abe-1ad8-4e57-9d72-ec733e56ca31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:01.003005 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-25c84abe-1ad8-4e57-9d72-ec733e56ca31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:01.003446 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-25c84abe-1ad8-4e57-9d72-ec733e56ca31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:01.067487 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-25c84abe-1ad8-4e57-9d72-ec733e56ca31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:01.075379 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-25c84abe-1ad8-4e57-9d72-ec733e56ca31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084458 Jul 21 17:57:01.075938 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 538/1083] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:02.092731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e86a363d-c79a-4dda-8f65-c9d05a16b2d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:02.093338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e86a363d-c79a-4dda-8f65-c9d05a16b2d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:02.100030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e86a363d-c79a-4dda-8f65-c9d05a16b2d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:02.100500 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e86a363d-c79a-4dda-8f65-c9d05a16b2d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:02.101258 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e86a363d-c79a-4dda-8f65-c9d05a16b2d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:02.101688 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e86a363d-c79a-4dda-8f65-c9d05a16b2d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:02.165063 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e86a363d-c79a-4dda-8f65-c9d05a16b2d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:02.172954 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e86a363d-c79a-4dda-8f65-c9d05a16b2d0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084110 Jul 21 17:57:02.173509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 546/1084] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:03.190957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0feeefb0-3dc4-4582-8a2c-c44e7c0cc0b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:03.192832 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0feeefb0-3dc4-4582-8a2c-c44e7c0cc0b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:03.198889 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0feeefb0-3dc4-4582-8a2c-c44e7c0cc0b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:03.199341 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0feeefb0-3dc4-4582-8a2c-c44e7c0cc0b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:03.200111 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0feeefb0-3dc4-4582-8a2c-c44e7c0cc0b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:03.200582 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0feeefb0-3dc4-4582-8a2c-c44e7c0cc0b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:03.261944 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0feeefb0-3dc4-4582-8a2c-c44e7c0cc0b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:03.269863 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0feeefb0-3dc4-4582-8a2c-c44e7c0cc0b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083210 Jul 21 17:57:03.270426 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 539/1085] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:03 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:04.286748 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-61177591-ea58-46a9-9394-2a36e582d9e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:04.287311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-61177591-ea58-46a9-9394-2a36e582d9e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:04.293963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-61177591-ea58-46a9-9394-2a36e582d9e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:04.294417 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-61177591-ea58-46a9-9394-2a36e582d9e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:04.295207 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-61177591-ea58-46a9-9394-2a36e582d9e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:04.295632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-61177591-ea58-46a9-9394-2a36e582d9e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:04.357400 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-61177591-ea58-46a9-9394-2a36e582d9e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:04.365394 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-61177591-ea58-46a9-9394-2a36e582d9e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082667 Jul 21 17:57:04.365953 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 547/1086] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:04 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:05.381416 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c1c91b33-dc9e-483d-b2ab-dac7a1d447ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:05.382070 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c1c91b33-dc9e-483d-b2ab-dac7a1d447ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:05.388765 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1c91b33-dc9e-483d-b2ab-dac7a1d447ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:05.389212 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1c91b33-dc9e-483d-b2ab-dac7a1d447ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:05.389975 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1c91b33-dc9e-483d-b2ab-dac7a1d447ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:05.390412 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c1c91b33-dc9e-483d-b2ab-dac7a1d447ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:05.454697 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c1c91b33-dc9e-483d-b2ab-dac7a1d447ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:05.463226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c1c91b33-dc9e-483d-b2ab-dac7a1d447ad tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085678 Jul 21 17:57:05.463787 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 540/1087] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:06.479635 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2c5b1b69-dcaa-45c8-9760-3e07a10b75de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:06.480324 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2c5b1b69-dcaa-45c8-9760-3e07a10b75de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:06.486911 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c5b1b69-dcaa-45c8-9760-3e07a10b75de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:06.487367 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c5b1b69-dcaa-45c8-9760-3e07a10b75de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:06.489134 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c5b1b69-dcaa-45c8-9760-3e07a10b75de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:06.489573 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2c5b1b69-dcaa-45c8-9760-3e07a10b75de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:06.556782 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2c5b1b69-dcaa-45c8-9760-3e07a10b75de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:06.565078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2c5b1b69-dcaa-45c8-9760-3e07a10b75de tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.089285 Jul 21 17:57:06.565649 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 548/1088] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:06 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:07.582733 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b23d36e5-fee5-4b25-b130-949ec93f5f5f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:07.583354 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b23d36e5-fee5-4b25-b130-949ec93f5f5f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:07.590019 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b23d36e5-fee5-4b25-b130-949ec93f5f5f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:07.590477 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b23d36e5-fee5-4b25-b130-949ec93f5f5f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:07.591245 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b23d36e5-fee5-4b25-b130-949ec93f5f5f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:07.591688 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b23d36e5-fee5-4b25-b130-949ec93f5f5f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:07.654380 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b23d36e5-fee5-4b25-b130-949ec93f5f5f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:07.662412 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b23d36e5-fee5-4b25-b130-949ec93f5f5f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083659 Jul 21 17:57:07.663191 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 541/1089] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:07 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:08.679330 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-476c7665-dffc-472a-a025-9b634dd6c075 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:08.679937 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-476c7665-dffc-472a-a025-9b634dd6c075 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:08.686418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-476c7665-dffc-472a-a025-9b634dd6c075 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:08.686864 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-476c7665-dffc-472a-a025-9b634dd6c075 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:08.687621 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-476c7665-dffc-472a-a025-9b634dd6c075 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:08.688059 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-476c7665-dffc-472a-a025-9b634dd6c075 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:08.750053 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-476c7665-dffc-472a-a025-9b634dd6c075 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:08.758407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-476c7665-dffc-472a-a025-9b634dd6c075 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083038 Jul 21 17:57:08.758962 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 549/1090] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:09.776094 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c204a54b-2335-4948-8aba-6b5cf6a83483 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:09.776749 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c204a54b-2335-4948-8aba-6b5cf6a83483 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:09.783302 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c204a54b-2335-4948-8aba-6b5cf6a83483 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:09.783749 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c204a54b-2335-4948-8aba-6b5cf6a83483 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:09.784543 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c204a54b-2335-4948-8aba-6b5cf6a83483 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:09.784985 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c204a54b-2335-4948-8aba-6b5cf6a83483 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:09.848287 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c204a54b-2335-4948-8aba-6b5cf6a83483 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:09.856929 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c204a54b-2335-4948-8aba-6b5cf6a83483 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085503 Jul 21 17:57:09.857487 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 542/1091] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:10.874550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-eacec116-9b1a-4706-b65b-6c9bd751ced7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:10.875194 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-eacec116-9b1a-4706-b65b-6c9bd751ced7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:10.882036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-eacec116-9b1a-4706-b65b-6c9bd751ced7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:10.882484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-eacec116-9b1a-4706-b65b-6c9bd751ced7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:10.883245 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-eacec116-9b1a-4706-b65b-6c9bd751ced7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:10.883675 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-eacec116-9b1a-4706-b65b-6c9bd751ced7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:10.947155 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-eacec116-9b1a-4706-b65b-6c9bd751ced7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:10.955422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-eacec116-9b1a-4706-b65b-6c9bd751ced7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084994 Jul 21 17:57:10.955983 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 550/1092] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:10 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:11.972637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-79a3a3ec-d8f0-416c-bca8-dcf5e07a6c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:11.973528 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-79a3a3ec-d8f0-416c-bca8-dcf5e07a6c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:11.980550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79a3a3ec-d8f0-416c-bca8-dcf5e07a6c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:11.981009 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79a3a3ec-d8f0-416c-bca8-dcf5e07a6c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:11.981790 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79a3a3ec-d8f0-416c-bca8-dcf5e07a6c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:11.982238 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79a3a3ec-d8f0-416c-bca8-dcf5e07a6c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:12.054902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-79a3a3ec-d8f0-416c-bca8-dcf5e07a6c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:12.063535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-79a3a3ec-d8f0-416c-bca8-dcf5e07a6c0c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.094751 Jul 21 17:57:12.064706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 543/1093] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:11 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:13.080630 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ca930779-6ac5-4563-afad-971f14dcbafb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:13.081240 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ca930779-6ac5-4563-afad-971f14dcbafb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:13.088365 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ca930779-6ac5-4563-afad-971f14dcbafb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:13.088819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ca930779-6ac5-4563-afad-971f14dcbafb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:13.089573 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ca930779-6ac5-4563-afad-971f14dcbafb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:13.090007 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ca930779-6ac5-4563-afad-971f14dcbafb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:13.151269 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ca930779-6ac5-4563-afad-971f14dcbafb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:13.159116 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ca930779-6ac5-4563-afad-971f14dcbafb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082388 Jul 21 17:57:13.159674 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 551/1094] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:14.176068 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2737beb2-dbbc-498b-8aa3-e57c1944ea94 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:14.176714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2737beb2-dbbc-498b-8aa3-e57c1944ea94 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:14.184376 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2737beb2-dbbc-498b-8aa3-e57c1944ea94 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:14.184792 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2737beb2-dbbc-498b-8aa3-e57c1944ea94 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:14.185566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2737beb2-dbbc-498b-8aa3-e57c1944ea94 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:14.186014 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2737beb2-dbbc-498b-8aa3-e57c1944ea94 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:14.190186 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=84 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:57:14.248063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2737beb2-dbbc-498b-8aa3-e57c1944ea94 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:14.257245 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2737beb2-dbbc-498b-8aa3-e57c1944ea94 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083873 Jul 21 17:57:14.257898 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 544/1095] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:14 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:15.274443 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4119e3c6-3b50-4486-adc9-3959893dd934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:15.274999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4119e3c6-3b50-4486-adc9-3959893dd934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:15.281411 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4119e3c6-3b50-4486-adc9-3959893dd934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:15.281859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4119e3c6-3b50-4486-adc9-3959893dd934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:15.282611 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4119e3c6-3b50-4486-adc9-3959893dd934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:15.283042 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4119e3c6-3b50-4486-adc9-3959893dd934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:15.346564 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4119e3c6-3b50-4486-adc9-3959893dd934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:15.354744 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4119e3c6-3b50-4486-adc9-3959893dd934 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084683 Jul 21 17:57:15.355295 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 552/1096] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:16.372130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7a7ae56e-53e5-40f3-b385-fbb61b510e13 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:16.372812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7a7ae56e-53e5-40f3-b385-fbb61b510e13 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:16.379386 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a7ae56e-53e5-40f3-b385-fbb61b510e13 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:16.379839 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a7ae56e-53e5-40f3-b385-fbb61b510e13 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:16.380638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a7ae56e-53e5-40f3-b385-fbb61b510e13 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:16.381551 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a7ae56e-53e5-40f3-b385-fbb61b510e13 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:16.442181 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7a7ae56e-53e5-40f3-b385-fbb61b510e13 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:16.450378 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7a7ae56e-53e5-40f3-b385-fbb61b510e13 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082089 Jul 21 17:57:16.450943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 545/1097] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:16 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:17.469055 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6e376d59-e617-4070-9cc5-9929dcd47a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:17.470008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6e376d59-e617-4070-9cc5-9929dcd47a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:17.477458 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6e376d59-e617-4070-9cc5-9929dcd47a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:17.477918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6e376d59-e617-4070-9cc5-9929dcd47a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:17.478692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6e376d59-e617-4070-9cc5-9929dcd47a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:17.479139 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6e376d59-e617-4070-9cc5-9929dcd47a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:17.539533 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6e376d59-e617-4070-9cc5-9929dcd47a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:17.547350 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6e376d59-e617-4070-9cc5-9929dcd47a03 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084271 Jul 21 17:57:17.547914 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 553/1098] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:17 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:18.565052 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-229553a7-156b-42c5-88c6-5847ef43c772 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:18.565668 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-229553a7-156b-42c5-88c6-5847ef43c772 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:18.572896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-229553a7-156b-42c5-88c6-5847ef43c772 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:18.573348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-229553a7-156b-42c5-88c6-5847ef43c772 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:18.574110 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-229553a7-156b-42c5-88c6-5847ef43c772 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:18.574547 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-229553a7-156b-42c5-88c6-5847ef43c772 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:18.636264 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-229553a7-156b-42c5-88c6-5847ef43c772 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:18.644624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-229553a7-156b-42c5-88c6-5847ef43c772 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083683 Jul 21 17:57:18.645639 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 546/1099] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:18 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:19.662185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-334684cf-5b2b-4790-a5a0-e92bf33a2d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:19.662804 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-334684cf-5b2b-4790-a5a0-e92bf33a2d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:19.669254 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-334684cf-5b2b-4790-a5a0-e92bf33a2d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:19.669701 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-334684cf-5b2b-4790-a5a0-e92bf33a2d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:19.670457 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-334684cf-5b2b-4790-a5a0-e92bf33a2d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:19.670895 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-334684cf-5b2b-4790-a5a0-e92bf33a2d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:19.743314 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-334684cf-5b2b-4790-a5a0-e92bf33a2d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:19.751280 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-334684cf-5b2b-4790-a5a0-e92bf33a2d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.092989 Jul 21 17:57:19.751841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 554/1100] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:19 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:20.769201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b37d276c-2d01-4610-87f1-3f8028c36b93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:20.769815 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b37d276c-2d01-4610-87f1-3f8028c36b93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:20.772716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=28 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:57:20.777996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b37d276c-2d01-4610-87f1-3f8028c36b93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:20.778445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b37d276c-2d01-4610-87f1-3f8028c36b93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:20.779217 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b37d276c-2d01-4610-87f1-3f8028c36b93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:20.779651 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b37d276c-2d01-4610-87f1-3f8028c36b93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:20.842175 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b37d276c-2d01-4610-87f1-3f8028c36b93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:20.850033 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b37d276c-2d01-4610-87f1-3f8028c36b93 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084693 Jul 21 17:57:20.850583 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 547/1101] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:20 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:21.867129 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-50606672-a923-4b0f-ada4-d9692ee21dd1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:21.867764 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-50606672-a923-4b0f-ada4-d9692ee21dd1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:21.870091 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=28 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:57:21.875485 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-50606672-a923-4b0f-ada4-d9692ee21dd1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:21.875937 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-50606672-a923-4b0f-ada4-d9692ee21dd1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:21.876731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-50606672-a923-4b0f-ada4-d9692ee21dd1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:21.877171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-50606672-a923-4b0f-ada4-d9692ee21dd1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:21.879866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=84 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:57:21.939746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-50606672-a923-4b0f-ada4-d9692ee21dd1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:21.947909 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-50606672-a923-4b0f-ada4-d9692ee21dd1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085048 Jul 21 17:57:21.948556 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 555/1102] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:22.964999 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-77215908-9b5a-469d-991b-fcb3a2816b63 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:22.965642 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-77215908-9b5a-469d-991b-fcb3a2816b63 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:22.972083 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77215908-9b5a-469d-991b-fcb3a2816b63 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:22.972564 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77215908-9b5a-469d-991b-fcb3a2816b63 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:22.973321 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77215908-9b5a-469d-991b-fcb3a2816b63 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:22.973756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77215908-9b5a-469d-991b-fcb3a2816b63 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:23.034349 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-77215908-9b5a-469d-991b-fcb3a2816b63 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:23.042837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-77215908-9b5a-469d-991b-fcb3a2816b63 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081660 Jul 21 17:57:23.043421 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 548/1103] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:22 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:24.059178 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f47c816a-ec61-4f0e-8ac3-24f05ad2076c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:24.059958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f47c816a-ec61-4f0e-8ac3-24f05ad2076c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:24.067105 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f47c816a-ec61-4f0e-8ac3-24f05ad2076c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:24.067560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f47c816a-ec61-4f0e-8ac3-24f05ad2076c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:24.068507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f47c816a-ec61-4f0e-8ac3-24f05ad2076c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:24.068945 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f47c816a-ec61-4f0e-8ac3-24f05ad2076c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:24.133105 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f47c816a-ec61-4f0e-8ac3-24f05ad2076c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:24.141078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f47c816a-ec61-4f0e-8ac3-24f05ad2076c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085917 Jul 21 17:57:24.141651 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 556/1104] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:24 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:25.159073 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-128db83b-c5c7-4a68-897b-758b7e86054c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:25.159687 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-128db83b-c5c7-4a68-897b-758b7e86054c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:25.166936 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-128db83b-c5c7-4a68-897b-758b7e86054c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:25.167385 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-128db83b-c5c7-4a68-897b-758b7e86054c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:25.168154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-128db83b-c5c7-4a68-897b-758b7e86054c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:25.168629 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-128db83b-c5c7-4a68-897b-758b7e86054c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:25.235916 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-128db83b-c5c7-4a68-897b-758b7e86054c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:25.245298 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-128db83b-c5c7-4a68-897b-758b7e86054c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.090065 Jul 21 17:57:25.245879 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 549/1105] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:25 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:26.263187 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1a4e9337-da89-4e0e-94b7-176303ac61ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:26.263754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1a4e9337-da89-4e0e-94b7-176303ac61ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:26.270194 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a4e9337-da89-4e0e-94b7-176303ac61ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:26.270646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a4e9337-da89-4e0e-94b7-176303ac61ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:26.271687 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a4e9337-da89-4e0e-94b7-176303ac61ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:26.272129 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a4e9337-da89-4e0e-94b7-176303ac61ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:26.332655 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1a4e9337-da89-4e0e-94b7-176303ac61ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:26.340589 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1a4e9337-da89-4e0e-94b7-176303ac61ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081446 Jul 21 17:57:26.341160 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 557/1106] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:26 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:27.356980 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-70112295-a378-4c8d-a08d-7a406cc8241e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:27.357521 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-70112295-a378-4c8d-a08d-7a406cc8241e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:27.364079 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70112295-a378-4c8d-a08d-7a406cc8241e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:27.364589 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70112295-a378-4c8d-a08d-7a406cc8241e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:27.365411 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70112295-a378-4c8d-a08d-7a406cc8241e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:27.365849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70112295-a378-4c8d-a08d-7a406cc8241e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:27.426055 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-70112295-a378-4c8d-a08d-7a406cc8241e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:27.434429 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-70112295-a378-4c8d-a08d-7a406cc8241e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081398 Jul 21 17:57:27.434998 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 550/1107] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:27 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:28.452491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-616f5750-0608-4c95-9203-d8b53815bfec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:28.453110 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-616f5750-0608-4c95-9203-d8b53815bfec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:28.460276 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-616f5750-0608-4c95-9203-d8b53815bfec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:28.460760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-616f5750-0608-4c95-9203-d8b53815bfec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:28.461533 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-616f5750-0608-4c95-9203-d8b53815bfec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:28.461980 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-616f5750-0608-4c95-9203-d8b53815bfec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:28.524552 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-616f5750-0608-4c95-9203-d8b53815bfec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:28.532504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-616f5750-0608-4c95-9203-d8b53815bfec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083942 Jul 21 17:57:28.533067 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 558/1108] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:28 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:29.550505 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4d890984-7c56-446e-9b4c-066b97e3dfb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:29.551118 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4d890984-7c56-446e-9b4c-066b97e3dfb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:29.558466 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d890984-7c56-446e-9b4c-066b97e3dfb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:29.558915 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d890984-7c56-446e-9b4c-066b97e3dfb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:29.559676 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d890984-7c56-446e-9b4c-066b97e3dfb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:29.560111 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d890984-7c56-446e-9b4c-066b97e3dfb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:29.621471 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4d890984-7c56-446e-9b4c-066b97e3dfb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:29.629486 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4d890984-7c56-446e-9b4c-066b97e3dfb3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082838 Jul 21 17:57:29.630096 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 551/1109] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:29 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:30.647724 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4722093a-448e-4d66-bd92-c9226488a3fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:30.648363 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4722093a-448e-4d66-bd92-c9226488a3fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:30.654919 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4722093a-448e-4d66-bd92-c9226488a3fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:30.655375 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4722093a-448e-4d66-bd92-c9226488a3fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:30.656140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4722093a-448e-4d66-bd92-c9226488a3fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:30.656615 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4722093a-448e-4d66-bd92-c9226488a3fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:30.717822 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4722093a-448e-4d66-bd92-c9226488a3fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:30.726112 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4722093a-448e-4d66-bd92-c9226488a3fc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083271 Jul 21 17:57:30.726681 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 559/1110] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:30 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:31.743126 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eb256656-b796-41a2-ac75-357e9b62723a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:31.743726 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eb256656-b796-41a2-ac75-357e9b62723a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:31.749975 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb256656-b796-41a2-ac75-357e9b62723a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:31.750431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb256656-b796-41a2-ac75-357e9b62723a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:31.751195 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb256656-b796-41a2-ac75-357e9b62723a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:31.751637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb256656-b796-41a2-ac75-357e9b62723a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:31.810987 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-eb256656-b796-41a2-ac75-357e9b62723a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:31.819615 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eb256656-b796-41a2-ac75-357e9b62723a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.080635 Jul 21 17:57:31.820178 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 552/1111] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:32.836232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0dd0c149-2b91-4755-a23b-49e1e5fa8b4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:32.836874 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0dd0c149-2b91-4755-a23b-49e1e5fa8b4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:32.843936 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0dd0c149-2b91-4755-a23b-49e1e5fa8b4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:32.844409 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0dd0c149-2b91-4755-a23b-49e1e5fa8b4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:32.845174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0dd0c149-2b91-4755-a23b-49e1e5fa8b4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:32.845613 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0dd0c149-2b91-4755-a23b-49e1e5fa8b4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:32.908572 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0dd0c149-2b91-4755-a23b-49e1e5fa8b4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:32.917415 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0dd0c149-2b91-4755-a23b-49e1e5fa8b4b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085002 Jul 21 17:57:32.918250 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 560/1112] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:32 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:33.933632 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-12baabd2-9743-46cc-aaa6-7f47f7da5579 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:33.934250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-12baabd2-9743-46cc-aaa6-7f47f7da5579 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:33.941100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-12baabd2-9743-46cc-aaa6-7f47f7da5579 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:33.941552 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-12baabd2-9743-46cc-aaa6-7f47f7da5579 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:33.942377 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-12baabd2-9743-46cc-aaa6-7f47f7da5579 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:33.943420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-12baabd2-9743-46cc-aaa6-7f47f7da5579 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:34.004333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-12baabd2-9743-46cc-aaa6-7f47f7da5579 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:34.012805 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-12baabd2-9743-46cc-aaa6-7f47f7da5579 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083034 Jul 21 17:57:34.013375 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 553/1113] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:33 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:35.029403 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-92b8b524-1adb-445a-be86-df45d0d4e855 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:35.030020 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-92b8b524-1adb-445a-be86-df45d0d4e855 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:35.037282 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92b8b524-1adb-445a-be86-df45d0d4e855 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:35.037744 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92b8b524-1adb-445a-be86-df45d0d4e855 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:35.038509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92b8b524-1adb-445a-be86-df45d0d4e855 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:35.038951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92b8b524-1adb-445a-be86-df45d0d4e855 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:35.102968 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-92b8b524-1adb-445a-be86-df45d0d4e855 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:35.110988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-92b8b524-1adb-445a-be86-df45d0d4e855 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085506 Jul 21 17:57:35.111555 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 561/1114] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:35 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:36.128258 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c845b697-041d-4e99-bf1c-0133b44d4705 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:36.128901 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c845b697-041d-4e99-bf1c-0133b44d4705 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:36.135997 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c845b697-041d-4e99-bf1c-0133b44d4705 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:36.136495 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c845b697-041d-4e99-bf1c-0133b44d4705 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:36.137263 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c845b697-041d-4e99-bf1c-0133b44d4705 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:36.137704 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c845b697-041d-4e99-bf1c-0133b44d4705 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:36.201911 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c845b697-041d-4e99-bf1c-0133b44d4705 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:36.209993 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c845b697-041d-4e99-bf1c-0133b44d4705 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085614 Jul 21 17:57:36.210561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 554/1115] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:36 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:37.227203 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e83f5371-ca00-4020-816c-f58163a264dd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:37.227757 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e83f5371-ca00-4020-816c-f58163a264dd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:37.234272 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e83f5371-ca00-4020-816c-f58163a264dd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:37.234732 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e83f5371-ca00-4020-816c-f58163a264dd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:37.235502 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e83f5371-ca00-4020-816c-f58163a264dd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:37.235944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e83f5371-ca00-4020-816c-f58163a264dd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:37.299291 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e83f5371-ca00-4020-816c-f58163a264dd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:37.308602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e83f5371-ca00-4020-816c-f58163a264dd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085485 Jul 21 17:57:37.309168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 562/1116] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:37 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:38.326294 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9ad19d59-05eb-457c-84a8-b473d5d73c60 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:38.326914 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9ad19d59-05eb-457c-84a8-b473d5d73c60 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:38.334069 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ad19d59-05eb-457c-84a8-b473d5d73c60 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:38.334518 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ad19d59-05eb-457c-84a8-b473d5d73c60 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:38.335318 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ad19d59-05eb-457c-84a8-b473d5d73c60 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:38.335757 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ad19d59-05eb-457c-84a8-b473d5d73c60 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:38.394482 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9ad19d59-05eb-457c-84a8-b473d5d73c60 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:38.402836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9ad19d59-05eb-457c-84a8-b473d5d73c60 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.080422 Jul 21 17:57:38.403407 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 555/1117] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:38 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:39.420209 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9f2f1b3d-b6b3-4d62-a762-a3fd24e0dfd4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:39.420857 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9f2f1b3d-b6b3-4d62-a762-a3fd24e0dfd4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:39.428068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9f2f1b3d-b6b3-4d62-a762-a3fd24e0dfd4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:39.428631 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9f2f1b3d-b6b3-4d62-a762-a3fd24e0dfd4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:39.429419 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9f2f1b3d-b6b3-4d62-a762-a3fd24e0dfd4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:39.429857 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9f2f1b3d-b6b3-4d62-a762-a3fd24e0dfd4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:39.489531 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9f2f1b3d-b6b3-4d62-a762-a3fd24e0dfd4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:39.498012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9f2f1b3d-b6b3-4d62-a762-a3fd24e0dfd4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081667 Jul 21 17:57:39.498577 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 563/1118] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:39 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:40.514922 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-05797f59-022f-4882-802c-ea26d6dcf6c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:40.515560 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-05797f59-022f-4882-802c-ea26d6dcf6c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:40.522202 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05797f59-022f-4882-802c-ea26d6dcf6c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:40.522649 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05797f59-022f-4882-802c-ea26d6dcf6c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:40.523408 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05797f59-022f-4882-802c-ea26d6dcf6c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:40.523846 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-05797f59-022f-4882-802c-ea26d6dcf6c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:40.585665 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-05797f59-022f-4882-802c-ea26d6dcf6c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:40.593665 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-05797f59-022f-4882-802c-ea26d6dcf6c7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082621 Jul 21 17:57:40.594232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 556/1119] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:41.610828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7802aebe-ddc1-4611-bff6-33ef9434012c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:41.611384 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7802aebe-ddc1-4611-bff6-33ef9434012c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:41.617927 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7802aebe-ddc1-4611-bff6-33ef9434012c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:41.618384 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7802aebe-ddc1-4611-bff6-33ef9434012c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:41.619159 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7802aebe-ddc1-4611-bff6-33ef9434012c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:41.619602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7802aebe-ddc1-4611-bff6-33ef9434012c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:41.688363 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7802aebe-ddc1-4611-bff6-33ef9434012c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:41.697177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7802aebe-ddc1-4611-bff6-33ef9434012c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.090340 Jul 21 17:57:41.697738 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 564/1120] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:41 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:42.714000 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-15025254-0978-446b-ac39-933520258601 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:42.714622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-15025254-0978-446b-ac39-933520258601 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:42.721157 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-15025254-0978-446b-ac39-933520258601 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:42.721611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-15025254-0978-446b-ac39-933520258601 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:42.722376 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-15025254-0978-446b-ac39-933520258601 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:42.722816 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-15025254-0978-446b-ac39-933520258601 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:42.782767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-15025254-0978-446b-ac39-933520258601 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:42.791348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-15025254-0978-446b-ac39-933520258601 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081248 Jul 21 17:57:42.791909 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 557/1121] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:42 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:57:43.808066 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-87a4a261-22f3-4c9d-b521-a1f22389e61a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:43.808712 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-87a4a261-22f3-4c9d-b521-a1f22389e61a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:43.815382 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-87a4a261-22f3-4c9d-b521-a1f22389e61a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:43.815829 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-87a4a261-22f3-4c9d-b521-a1f22389e61a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:43.816617 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-87a4a261-22f3-4c9d-b521-a1f22389e61a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:43.817053 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-87a4a261-22f3-4c9d-b521-a1f22389e61a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:43.877610 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-87a4a261-22f3-4c9d-b521-a1f22389e61a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:43.886355 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-87a4a261-22f3-4c9d-b521-a1f22389e61a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082171 Jul 21 17:57:43.886908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 565/1122] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:57:44.902984 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f58fc886-c413-4d69-bd2f-2efbffb6e6ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:44.903608 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f58fc886-c413-4d69-bd2f-2efbffb6e6ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:44.910264 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f58fc886-c413-4d69-bd2f-2efbffb6e6ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:44.910666 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f58fc886-c413-4d69-bd2f-2efbffb6e6ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:44.911470 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f58fc886-c413-4d69-bd2f-2efbffb6e6ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:44.911914 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f58fc886-c413-4d69-bd2f-2efbffb6e6ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:44.914571 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=84 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:57:44.974058 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f58fc886-c413-4d69-bd2f-2efbffb6e6ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:44.982120 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f58fc886-c413-4d69-bd2f-2efbffb6e6ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083008 Jul 21 17:57:44.982683 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 558/1123] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:44 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:45.999022 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e41f3223-cb7d-49d4-8075-be215207d808 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:45.999636 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e41f3223-cb7d-49d4-8075-be215207d808 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:46.006171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e41f3223-cb7d-49d4-8075-be215207d808 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:46.006648 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e41f3223-cb7d-49d4-8075-be215207d808 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:46.007468 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e41f3223-cb7d-49d4-8075-be215207d808 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:46.007931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e41f3223-cb7d-49d4-8075-be215207d808 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:46.072066 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e41f3223-cb7d-49d4-8075-be215207d808 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:46.080878 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e41f3223-cb7d-49d4-8075-be215207d808 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085677 Jul 21 17:57:46.081711 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 566/1124] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:45 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:47.098106 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c745503d-8124-4ede-a06d-ef14e246eb62 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:47.098706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c745503d-8124-4ede-a06d-ef14e246eb62 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:47.106011 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c745503d-8124-4ede-a06d-ef14e246eb62 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:47.106461 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c745503d-8124-4ede-a06d-ef14e246eb62 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:47.107222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c745503d-8124-4ede-a06d-ef14e246eb62 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:47.107659 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c745503d-8124-4ede-a06d-ef14e246eb62 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:47.167778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c745503d-8124-4ede-a06d-ef14e246eb62 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:47.175693 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c745503d-8124-4ede-a06d-ef14e246eb62 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081574 Jul 21 17:57:47.176248 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 559/1125] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:48.194560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0f1ca686-1354-47cc-bf59-faed1fb7911a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:48.195100 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0f1ca686-1354-47cc-bf59-faed1fb7911a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:48.201544 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0f1ca686-1354-47cc-bf59-faed1fb7911a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:48.201991 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0f1ca686-1354-47cc-bf59-faed1fb7911a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:48.202743 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0f1ca686-1354-47cc-bf59-faed1fb7911a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:48.203177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0f1ca686-1354-47cc-bf59-faed1fb7911a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:48.268174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0f1ca686-1354-47cc-bf59-faed1fb7911a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:48.276499 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0f1ca686-1354-47cc-bf59-faed1fb7911a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086457 Jul 21 17:57:48.277062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 567/1126] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:48 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:57:49.292949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-17ae39a4-4021-4a52-8b94-89eaa171c532 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:49.293513 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-17ae39a4-4021-4a52-8b94-89eaa171c532 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:49.300163 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17ae39a4-4021-4a52-8b94-89eaa171c532 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:49.300716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17ae39a4-4021-4a52-8b94-89eaa171c532 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:49.301491 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17ae39a4-4021-4a52-8b94-89eaa171c532 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:49.302036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17ae39a4-4021-4a52-8b94-89eaa171c532 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:49.363382 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-17ae39a4-4021-4a52-8b94-89eaa171c532 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:49.377897 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-17ae39a4-4021-4a52-8b94-89eaa171c532 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083040 Jul 21 17:57:49.378925 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 560/1127] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:49 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:50.395230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5c4612ac-2fcb-4528-81d5-9e37e895e482 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:50.396586 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5c4612ac-2fcb-4528-81d5-9e37e895e482 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:50.403144 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c4612ac-2fcb-4528-81d5-9e37e895e482 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:50.403596 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c4612ac-2fcb-4528-81d5-9e37e895e482 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:50.404384 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c4612ac-2fcb-4528-81d5-9e37e895e482 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:50.404825 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5c4612ac-2fcb-4528-81d5-9e37e895e482 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:50.470101 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5c4612ac-2fcb-4528-81d5-9e37e895e482 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:50.478689 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5c4612ac-2fcb-4528-81d5-9e37e895e482 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087308 Jul 21 17:57:50.479247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 568/1128] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:50 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:51.495458 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-054baef7-a745-4786-9877-b8bdcd3bfff8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:51.496081 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-054baef7-a745-4786-9877-b8bdcd3bfff8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:51.498474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=28 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:57:51.503827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-054baef7-a745-4786-9877-b8bdcd3bfff8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:51.504222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-054baef7-a745-4786-9877-b8bdcd3bfff8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:51.505267 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-054baef7-a745-4786-9877-b8bdcd3bfff8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:51.506088 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-054baef7-a745-4786-9877-b8bdcd3bfff8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:51.569880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-054baef7-a745-4786-9877-b8bdcd3bfff8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:51.577857 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-054baef7-a745-4786-9877-b8bdcd3bfff8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086295 Jul 21 17:57:51.578455 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 561/1129] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:52.594696 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-df944dad-a913-40c3-8f2d-006ec0e327e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:52.595305 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-df944dad-a913-40c3-8f2d-006ec0e327e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:52.597710 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=28 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:57:52.603928 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df944dad-a913-40c3-8f2d-006ec0e327e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:52.604396 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df944dad-a913-40c3-8f2d-006ec0e327e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:52.605155 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df944dad-a913-40c3-8f2d-006ec0e327e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:52.605589 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df944dad-a913-40c3-8f2d-006ec0e327e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:52.608272 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=84 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:57:52.668170 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-df944dad-a913-40c3-8f2d-006ec0e327e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:52.676036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-df944dad-a913-40c3-8f2d-006ec0e327e2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085232 Jul 21 17:57:52.676627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 569/1130] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:52 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:53.692522 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-44753a78-b1a6-42c8-b9d5-12b7394f8ab6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:53.693142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-44753a78-b1a6-42c8-b9d5-12b7394f8ab6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:53.700265 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44753a78-b1a6-42c8-b9d5-12b7394f8ab6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:53.700749 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44753a78-b1a6-42c8-b9d5-12b7394f8ab6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:53.701532 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44753a78-b1a6-42c8-b9d5-12b7394f8ab6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:53.701972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44753a78-b1a6-42c8-b9d5-12b7394f8ab6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:53.763364 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-44753a78-b1a6-42c8-b9d5-12b7394f8ab6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:53.771325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-44753a78-b1a6-42c8-b9d5-12b7394f8ab6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082990 Jul 21 17:57:53.771890 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 562/1131] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:53 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:54.787009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0c5ab823-5a60-4a8f-a114-e3c9cd20ced5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:54.787615 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0c5ab823-5a60-4a8f-a114-e3c9cd20ced5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:54.794089 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0c5ab823-5a60-4a8f-a114-e3c9cd20ced5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:54.794535 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0c5ab823-5a60-4a8f-a114-e3c9cd20ced5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:54.795292 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0c5ab823-5a60-4a8f-a114-e3c9cd20ced5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:54.795728 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0c5ab823-5a60-4a8f-a114-e3c9cd20ced5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:54.859023 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0c5ab823-5a60-4a8f-a114-e3c9cd20ced5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:54.867346 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0c5ab823-5a60-4a8f-a114-e3c9cd20ced5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084201 Jul 21 17:57:54.867904 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 570/1132] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:54 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:55.884654 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8887a15d-229c-45f6-bd07-6ba9bab8187a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:55.885305 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8887a15d-229c-45f6-bd07-6ba9bab8187a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:55.891668 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8887a15d-229c-45f6-bd07-6ba9bab8187a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:55.892145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8887a15d-229c-45f6-bd07-6ba9bab8187a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:55.892947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8887a15d-229c-45f6-bd07-6ba9bab8187a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:55.893381 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8887a15d-229c-45f6-bd07-6ba9bab8187a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:55.955479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8887a15d-229c-45f6-bd07-6ba9bab8187a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:55.967585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8887a15d-229c-45f6-bd07-6ba9bab8187a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086837 Jul 21 17:57:55.968150 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 563/1133] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:55 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:56.984451 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7d5fc5f6-83c7-4cb6-ab63-f5f4595360e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:56.985071 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7d5fc5f6-83c7-4cb6-ab63-f5f4595360e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:56.992436 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d5fc5f6-83c7-4cb6-ab63-f5f4595360e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:56.992919 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d5fc5f6-83c7-4cb6-ab63-f5f4595360e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:56.993684 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d5fc5f6-83c7-4cb6-ab63-f5f4595360e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:56.994121 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7d5fc5f6-83c7-4cb6-ab63-f5f4595360e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:57.055415 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7d5fc5f6-83c7-4cb6-ab63-f5f4595360e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:57.063664 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7d5fc5f6-83c7-4cb6-ab63-f5f4595360e3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082835 Jul 21 17:57:57.064228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 571/1134] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:56 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:58.081251 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a72f8884-78da-4d39-a404-49cfc9b75fbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:58.081883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a72f8884-78da-4d39-a404-49cfc9b75fbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:58.093342 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a72f8884-78da-4d39-a404-49cfc9b75fbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:58.093817 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a72f8884-78da-4d39-a404-49cfc9b75fbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:58.094583 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a72f8884-78da-4d39-a404-49cfc9b75fbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:58.095095 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a72f8884-78da-4d39-a404-49cfc9b75fbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:58.156165 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a72f8884-78da-4d39-a404-49cfc9b75fbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:58.164203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a72f8884-78da-4d39-a404-49cfc9b75fbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086793 Jul 21 17:57:58.164866 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 564/1135] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:58 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:57:59.181843 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b3b19024-4e93-42e4-80f6-c8f53331450c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:57:59.182460 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b3b19024-4e93-42e4-80f6-c8f53331450c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:57:59.189264 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3b19024-4e93-42e4-80f6-c8f53331450c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:59.189661 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3b19024-4e93-42e4-80f6-c8f53331450c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:59.190426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3b19024-4e93-42e4-80f6-c8f53331450c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:57:59.190864 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3b19024-4e93-42e4-80f6-c8f53331450c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:57:59.254107 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b3b19024-4e93-42e4-80f6-c8f53331450c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:57:59.262156 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b3b19024-4e93-42e4-80f6-c8f53331450c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084260 Jul 21 17:57:59.262721 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 572/1136] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:57:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:00.279143 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d1d47e79-7cf2-4d86-a496-1613cf801353 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:00.279698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d1d47e79-7cf2-4d86-a496-1613cf801353 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:00.286972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1d47e79-7cf2-4d86-a496-1613cf801353 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:00.287425 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1d47e79-7cf2-4d86-a496-1613cf801353 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:00.288197 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1d47e79-7cf2-4d86-a496-1613cf801353 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:00.288665 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d1d47e79-7cf2-4d86-a496-1613cf801353 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:00.577177 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d1d47e79-7cf2-4d86-a496-1613cf801353 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:00.585340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d1d47e79-7cf2-4d86-a496-1613cf801353 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.310179 Jul 21 17:58:00.585900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 565/1137] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:01.602495 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-539b54da-b0a2-4d65-9bd7-3aefe1a953f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:01.603113 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-539b54da-b0a2-4d65-9bd7-3aefe1a953f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:01.609468 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-539b54da-b0a2-4d65-9bd7-3aefe1a953f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:01.609997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-539b54da-b0a2-4d65-9bd7-3aefe1a953f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:01.610768 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-539b54da-b0a2-4d65-9bd7-3aefe1a953f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:01.611205 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-539b54da-b0a2-4d65-9bd7-3aefe1a953f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:01.671324 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-539b54da-b0a2-4d65-9bd7-3aefe1a953f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:01.679820 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-539b54da-b0a2-4d65-9bd7-3aefe1a953f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081614 Jul 21 17:58:01.680425 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 573/1138] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:01 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:02.697512 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e08952d3-987c-4a85-987d-44d36e9465f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:02.698132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e08952d3-987c-4a85-987d-44d36e9465f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:02.704217 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e08952d3-987c-4a85-987d-44d36e9465f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:02.704700 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e08952d3-987c-4a85-987d-44d36e9465f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:02.705470 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e08952d3-987c-4a85-987d-44d36e9465f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:02.705912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e08952d3-987c-4a85-987d-44d36e9465f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:02.765583 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e08952d3-987c-4a85-987d-44d36e9465f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:02.774232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e08952d3-987c-4a85-987d-44d36e9465f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.080766 Jul 21 17:58:02.774794 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 566/1139] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:03.791698 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1e8c0e3c-9acb-4b21-b688-2ddf4a4c5189 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:03.792338 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1e8c0e3c-9acb-4b21-b688-2ddf4a4c5189 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:03.798783 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1e8c0e3c-9acb-4b21-b688-2ddf4a4c5189 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:03.799234 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1e8c0e3c-9acb-4b21-b688-2ddf4a4c5189 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:03.800000 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1e8c0e3c-9acb-4b21-b688-2ddf4a4c5189 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:03.800466 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1e8c0e3c-9acb-4b21-b688-2ddf4a4c5189 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:03.862767 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1e8c0e3c-9acb-4b21-b688-2ddf4a4c5189 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:03.871017 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1e8c0e3c-9acb-4b21-b688-2ddf4a4c5189 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083132 Jul 21 17:58:03.871581 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 574/1140] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:03 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:04.888025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f3cf2bc4-5180-4f7b-a0be-4a9b9f36554d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:04.888678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f3cf2bc4-5180-4f7b-a0be-4a9b9f36554d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:04.895243 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3cf2bc4-5180-4f7b-a0be-4a9b9f36554d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:04.895703 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3cf2bc4-5180-4f7b-a0be-4a9b9f36554d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:04.896715 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3cf2bc4-5180-4f7b-a0be-4a9b9f36554d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:04.897160 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3cf2bc4-5180-4f7b-a0be-4a9b9f36554d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:04.960277 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f3cf2bc4-5180-4f7b-a0be-4a9b9f36554d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:04.968214 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f3cf2bc4-5180-4f7b-a0be-4a9b9f36554d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084060 Jul 21 17:58:04.969065 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 567/1141] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:04 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:05.985527 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8fd3d055-899f-4a26-8ca2-7932ec194d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:05.986140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8fd3d055-899f-4a26-8ca2-7932ec194d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:05.993107 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8fd3d055-899f-4a26-8ca2-7932ec194d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:05.993551 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8fd3d055-899f-4a26-8ca2-7932ec194d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:05.994336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8fd3d055-899f-4a26-8ca2-7932ec194d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:05.994772 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8fd3d055-899f-4a26-8ca2-7932ec194d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:06.055036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8fd3d055-899f-4a26-8ca2-7932ec194d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:06.062844 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8fd3d055-899f-4a26-8ca2-7932ec194d59 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081493 Jul 21 17:58:06.063659 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 575/1142] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:07.081100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-91b3683f-6cc5-4412-bde1-f74a48807111 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:07.081715 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-91b3683f-6cc5-4412-bde1-f74a48807111 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:07.088811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91b3683f-6cc5-4412-bde1-f74a48807111 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:07.089265 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91b3683f-6cc5-4412-bde1-f74a48807111 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:07.090027 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91b3683f-6cc5-4412-bde1-f74a48807111 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:07.090467 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91b3683f-6cc5-4412-bde1-f74a48807111 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:07.152273 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-91b3683f-6cc5-4412-bde1-f74a48807111 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:07.160099 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-91b3683f-6cc5-4412-bde1-f74a48807111 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082874 Jul 21 17:58:07.160694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 568/1143] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:07 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:08.176628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c19127f1-db05-429c-8f0c-79ccd966552d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:08.177238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c19127f1-db05-429c-8f0c-79ccd966552d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:08.183806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c19127f1-db05-429c-8f0c-79ccd966552d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:08.184331 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c19127f1-db05-429c-8f0c-79ccd966552d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:08.185037 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c19127f1-db05-429c-8f0c-79ccd966552d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:08.185471 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c19127f1-db05-429c-8f0c-79ccd966552d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:08.246771 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c19127f1-db05-429c-8f0c-79ccd966552d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:08.254669 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c19127f1-db05-429c-8f0c-79ccd966552d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081872 Jul 21 17:58:08.255498 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 576/1144] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:09.271958 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-65e70fd0-7ae4-4b4e-9cb2-678447a9e18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:09.272557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-65e70fd0-7ae4-4b4e-9cb2-678447a9e18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:09.278926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65e70fd0-7ae4-4b4e-9cb2-678447a9e18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:09.279376 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65e70fd0-7ae4-4b4e-9cb2-678447a9e18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:09.280134 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65e70fd0-7ae4-4b4e-9cb2-678447a9e18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:09.280600 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65e70fd0-7ae4-4b4e-9cb2-678447a9e18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:09.344530 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-65e70fd0-7ae4-4b4e-9cb2-678447a9e18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:09.352569 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-65e70fd0-7ae4-4b4e-9cb2-678447a9e18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085161 Jul 21 17:58:09.353122 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 569/1145] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:10.369539 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-899aa735-029e-4fd3-b0b3-eeeae4a86fdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:10.370169 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-899aa735-029e-4fd3-b0b3-eeeae4a86fdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:10.376787 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-899aa735-029e-4fd3-b0b3-eeeae4a86fdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:10.377229 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-899aa735-029e-4fd3-b0b3-eeeae4a86fdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:10.377980 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-899aa735-029e-4fd3-b0b3-eeeae4a86fdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:10.378412 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-899aa735-029e-4fd3-b0b3-eeeae4a86fdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:10.489277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-899aa735-029e-4fd3-b0b3-eeeae4a86fdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:10.497413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-899aa735-029e-4fd3-b0b3-eeeae4a86fdc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.132151 Jul 21 17:58:10.497972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 577/1146] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:10 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:11.514603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-60684a1d-fc83-48fd-86e1-eba5d214878d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:11.515168 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-60684a1d-fc83-48fd-86e1-eba5d214878d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:11.521985 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60684a1d-fc83-48fd-86e1-eba5d214878d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:11.522474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60684a1d-fc83-48fd-86e1-eba5d214878d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:11.523250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60684a1d-fc83-48fd-86e1-eba5d214878d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:11.523692 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60684a1d-fc83-48fd-86e1-eba5d214878d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:11.584134 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-60684a1d-fc83-48fd-86e1-eba5d214878d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:11.592148 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-60684a1d-fc83-48fd-86e1-eba5d214878d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081529 Jul 21 17:58:11.592747 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 570/1147] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:11 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:12.609715 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0fe03f1f-2167-4e39-9417-74d9544ed2f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:12.610346 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0fe03f1f-2167-4e39-9417-74d9544ed2f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:12.617834 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fe03f1f-2167-4e39-9417-74d9544ed2f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:12.618287 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fe03f1f-2167-4e39-9417-74d9544ed2f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:12.619111 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fe03f1f-2167-4e39-9417-74d9544ed2f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:12.619558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fe03f1f-2167-4e39-9417-74d9544ed2f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:12.681764 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0fe03f1f-2167-4e39-9417-74d9544ed2f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:12.689922 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0fe03f1f-2167-4e39-9417-74d9544ed2f2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084093 Jul 21 17:58:12.690479 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 578/1148] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:12 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:13.706918 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-223cb768-0305-4f9e-acda-f8527e75f22b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:13.707532 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-223cb768-0305-4f9e-acda-f8527e75f22b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:13.714519 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-223cb768-0305-4f9e-acda-f8527e75f22b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:13.714970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-223cb768-0305-4f9e-acda-f8527e75f22b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:13.715739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-223cb768-0305-4f9e-acda-f8527e75f22b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:13.716173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-223cb768-0305-4f9e-acda-f8527e75f22b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:13.778692 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-223cb768-0305-4f9e-acda-f8527e75f22b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:13.786739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-223cb768-0305-4f9e-acda-f8527e75f22b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083635 Jul 21 17:58:13.787823 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 571/1149] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:14.803993 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-93ed8d1a-0dc2-44a9-a3e1-4f9e4e490b0b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:14.804636 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-93ed8d1a-0dc2-44a9-a3e1-4f9e4e490b0b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:14.811217 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93ed8d1a-0dc2-44a9-a3e1-4f9e4e490b0b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:14.811672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93ed8d1a-0dc2-44a9-a3e1-4f9e4e490b0b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:14.812484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93ed8d1a-0dc2-44a9-a3e1-4f9e4e490b0b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:14.812933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93ed8d1a-0dc2-44a9-a3e1-4f9e4e490b0b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:14.874114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-93ed8d1a-0dc2-44a9-a3e1-4f9e4e490b0b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:14.883014 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-93ed8d1a-0dc2-44a9-a3e1-4f9e4e490b0b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082899 Jul 21 17:58:14.883583 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 579/1150] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:14 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:15.900059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-11a81c9f-8fcf-41df-ad78-6057f16dfc54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:15.900700 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-11a81c9f-8fcf-41df-ad78-6057f16dfc54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:15.907279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11a81c9f-8fcf-41df-ad78-6057f16dfc54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:15.907723 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11a81c9f-8fcf-41df-ad78-6057f16dfc54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:15.908511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11a81c9f-8fcf-41df-ad78-6057f16dfc54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:15.908945 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11a81c9f-8fcf-41df-ad78-6057f16dfc54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:15.913385 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=84 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:58:15.971108 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11a81c9f-8fcf-41df-ad78-6057f16dfc54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:15.979695 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-11a81c9f-8fcf-41df-ad78-6057f16dfc54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084084 Jul 21 17:58:15.980253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 572/1151] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:16.997128 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0baa13b3-efff-466e-9491-8f7f2c7b1bb2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:16.997749 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0baa13b3-efff-466e-9491-8f7f2c7b1bb2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:17.004233 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0baa13b3-efff-466e-9491-8f7f2c7b1bb2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:17.004718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0baa13b3-efff-466e-9491-8f7f2c7b1bb2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:17.005491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0baa13b3-efff-466e-9491-8f7f2c7b1bb2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:17.005963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0baa13b3-efff-466e-9491-8f7f2c7b1bb2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:17.066413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0baa13b3-efff-466e-9491-8f7f2c7b1bb2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:17.074318 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0baa13b3-efff-466e-9491-8f7f2c7b1bb2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081089 Jul 21 17:58:17.074888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 580/1152] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:16 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:18.091256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-53aa7704-9024-4716-82a6-0de81dafe0cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:18.091944 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-53aa7704-9024-4716-82a6-0de81dafe0cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:18.098678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53aa7704-9024-4716-82a6-0de81dafe0cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:18.099129 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53aa7704-9024-4716-82a6-0de81dafe0cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:18.099947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53aa7704-9024-4716-82a6-0de81dafe0cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:18.100419 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53aa7704-9024-4716-82a6-0de81dafe0cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:18.162896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-53aa7704-9024-4716-82a6-0de81dafe0cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:18.170749 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-53aa7704-9024-4716-82a6-0de81dafe0cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083468 Jul 21 17:58:18.171316 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 573/1153] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:18 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:19.187975 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-38d379c4-0e88-486f-8f66-98f563b3075f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:19.188811 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-38d379c4-0e88-486f-8f66-98f563b3075f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:19.195985 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-38d379c4-0e88-486f-8f66-98f563b3075f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:19.196459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-38d379c4-0e88-486f-8f66-98f563b3075f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:19.197217 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-38d379c4-0e88-486f-8f66-98f563b3075f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:19.197650 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-38d379c4-0e88-486f-8f66-98f563b3075f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:19.260121 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-38d379c4-0e88-486f-8f66-98f563b3075f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:19.267967 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-38d379c4-0e88-486f-8f66-98f563b3075f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083900 Jul 21 17:58:19.268563 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 581/1154] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:19 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:20.285614 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0318931f-dc00-4b9a-a63a-51cf078333b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:20.286171 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0318931f-dc00-4b9a-a63a-51cf078333b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:20.292681 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0318931f-dc00-4b9a-a63a-51cf078333b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:20.293129 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0318931f-dc00-4b9a-a63a-51cf078333b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:20.293888 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0318931f-dc00-4b9a-a63a-51cf078333b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:20.294324 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0318931f-dc00-4b9a-a63a-51cf078333b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:20.356870 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0318931f-dc00-4b9a-a63a-51cf078333b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:20.364683 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0318931f-dc00-4b9a-a63a-51cf078333b4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082948 Jul 21 17:58:20.365744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 574/1155] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:20 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:21.382928 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8b3096c1-b849-4d46-aa39-575b4b096913 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:21.383523 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8b3096c1-b849-4d46-aa39-575b4b096913 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:21.389844 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8b3096c1-b849-4d46-aa39-575b4b096913 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:21.390286 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8b3096c1-b849-4d46-aa39-575b4b096913 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:21.391039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8b3096c1-b849-4d46-aa39-575b4b096913 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:21.391470 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8b3096c1-b849-4d46-aa39-575b4b096913 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:21.454989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8b3096c1-b849-4d46-aa39-575b4b096913 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:21.463552 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8b3096c1-b849-4d46-aa39-575b4b096913 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085312 Jul 21 17:58:21.464110 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 582/1156] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:22.480316 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b18985f1-2094-47b7-b134-b515a060abcd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:22.480912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b18985f1-2094-47b7-b134-b515a060abcd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:22.483284 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=28 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:58:22.488610 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b18985f1-2094-47b7-b134-b515a060abcd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:22.489062 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b18985f1-2094-47b7-b134-b515a060abcd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:22.489820 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b18985f1-2094-47b7-b134-b515a060abcd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:22.490269 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b18985f1-2094-47b7-b134-b515a060abcd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:22.553085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b18985f1-2094-47b7-b134-b515a060abcd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:22.561256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b18985f1-2094-47b7-b134-b515a060abcd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084845 Jul 21 17:58:22.561821 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 575/1157] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:22 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:23.578303 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-704769d1-1c35-4901-ad71-1addc47b69bb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:23.578973 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-704769d1-1c35-4901-ad71-1addc47b69bb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:23.581335 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=28 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:58:23.587422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-704769d1-1c35-4901-ad71-1addc47b69bb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:23.587869 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-704769d1-1c35-4901-ad71-1addc47b69bb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:23.588657 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-704769d1-1c35-4901-ad71-1addc47b69bb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:23.589094 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-704769d1-1c35-4901-ad71-1addc47b69bb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:23.591776 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=84 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:58:23.651093 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-704769d1-1c35-4901-ad71-1addc47b69bb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:23.659198 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-704769d1-1c35-4901-ad71-1addc47b69bb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084825 Jul 21 17:58:23.659763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 583/1158] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:23 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:24.676013 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0724db50-59e1-4147-89e7-b3a5b8e1725d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:24.676653 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0724db50-59e1-4147-89e7-b3a5b8e1725d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:24.683594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0724db50-59e1-4147-89e7-b3a5b8e1725d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:24.684043 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0724db50-59e1-4147-89e7-b3a5b8e1725d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:24.684830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0724db50-59e1-4147-89e7-b3a5b8e1725d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:24.685268 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0724db50-59e1-4147-89e7-b3a5b8e1725d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:24.748268 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0724db50-59e1-4147-89e7-b3a5b8e1725d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:24.756535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0724db50-59e1-4147-89e7-b3a5b8e1725d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084242 Jul 21 17:58:24.759834 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 576/1159] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:24 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:25.774372 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d772712d-68ca-4a83-b431-58ab240919cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:25.774967 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d772712d-68ca-4a83-b431-58ab240919cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:25.781566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d772712d-68ca-4a83-b431-58ab240919cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:25.782014 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d772712d-68ca-4a83-b431-58ab240919cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:25.782763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d772712d-68ca-4a83-b431-58ab240919cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:25.783199 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d772712d-68ca-4a83-b431-58ab240919cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:25.845064 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d772712d-68ca-4a83-b431-58ab240919cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:25.854277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d772712d-68ca-4a83-b431-58ab240919cf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083958 Jul 21 17:58:25.854858 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 584/1160] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:25 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:26.871423 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2a6781e6-b4b7-499a-9d4e-e551e38c273c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:26.872040 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2a6781e6-b4b7-499a-9d4e-e551e38c273c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:26.878929 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2a6781e6-b4b7-499a-9d4e-e551e38c273c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:26.879402 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2a6781e6-b4b7-499a-9d4e-e551e38c273c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:26.880168 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2a6781e6-b4b7-499a-9d4e-e551e38c273c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:26.880639 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2a6781e6-b4b7-499a-9d4e-e551e38c273c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:26.949458 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2a6781e6-b4b7-499a-9d4e-e551e38c273c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:26.957432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2a6781e6-b4b7-499a-9d4e-e551e38c273c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.089867 Jul 21 17:58:26.964248 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 577/1161] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:26 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:27.980903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8659ca39-9dc7-4b2c-ac36-61274abeb05c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:27.981496 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8659ca39-9dc7-4b2c-ac36-61274abeb05c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:27.987967 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8659ca39-9dc7-4b2c-ac36-61274abeb05c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:27.988444 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8659ca39-9dc7-4b2c-ac36-61274abeb05c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:27.989208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8659ca39-9dc7-4b2c-ac36-61274abeb05c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:27.989644 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8659ca39-9dc7-4b2c-ac36-61274abeb05c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:28.050305 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8659ca39-9dc7-4b2c-ac36-61274abeb05c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:28.058406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8659ca39-9dc7-4b2c-ac36-61274abeb05c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081445 Jul 21 17:58:28.058964 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 585/1162] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:27 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:29.075249 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2d3bed8e-d41e-4017-9147-408f198db01a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:29.075859 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2d3bed8e-d41e-4017-9147-408f198db01a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:29.082336 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d3bed8e-d41e-4017-9147-408f198db01a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:29.082782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d3bed8e-d41e-4017-9147-408f198db01a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:29.083556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d3bed8e-d41e-4017-9147-408f198db01a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:29.084015 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d3bed8e-d41e-4017-9147-408f198db01a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:29.144272 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2d3bed8e-d41e-4017-9147-408f198db01a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:29.152632 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2d3bed8e-d41e-4017-9147-408f198db01a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081244 Jul 21 17:58:29.153190 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 578/1163] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:29 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:30.169339 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d7791a34-67b0-4a50-a2ad-2d44247d1207 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:30.169984 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d7791a34-67b0-4a50-a2ad-2d44247d1207 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:30.176455 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d7791a34-67b0-4a50-a2ad-2d44247d1207 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:30.176905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d7791a34-67b0-4a50-a2ad-2d44247d1207 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:30.178118 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d7791a34-67b0-4a50-a2ad-2d44247d1207 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:30.178573 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d7791a34-67b0-4a50-a2ad-2d44247d1207 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:30.240771 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d7791a34-67b0-4a50-a2ad-2d44247d1207 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:30.248616 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d7791a34-67b0-4a50-a2ad-2d44247d1207 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083155 Jul 21 17:58:30.249183 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 586/1164] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:30 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:31.266533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9fc00d0c-d0c2-4793-b9bc-a56a72321abd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:31.267092 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9fc00d0c-d0c2-4793-b9bc-a56a72321abd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:31.273319 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9fc00d0c-d0c2-4793-b9bc-a56a72321abd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:31.273776 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9fc00d0c-d0c2-4793-b9bc-a56a72321abd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:31.274543 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9fc00d0c-d0c2-4793-b9bc-a56a72321abd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:31.274993 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9fc00d0c-d0c2-4793-b9bc-a56a72321abd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:31.337541 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9fc00d0c-d0c2-4793-b9bc-a56a72321abd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:31.345439 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9fc00d0c-d0c2-4793-b9bc-a56a72321abd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082877 Jul 21 17:58:31.346003 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 579/1165] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:32.362504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-76357344-0e87-42ef-9593-d28c0383735a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:32.363066 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-76357344-0e87-42ef-9593-d28c0383735a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:32.369768 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-76357344-0e87-42ef-9593-d28c0383735a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:32.370214 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-76357344-0e87-42ef-9593-d28c0383735a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:32.370972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-76357344-0e87-42ef-9593-d28c0383735a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:32.371408 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-76357344-0e87-42ef-9593-d28c0383735a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:32.433440 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-76357344-0e87-42ef-9593-d28c0383735a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:32.441570 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-76357344-0e87-42ef-9593-d28c0383735a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083049 Jul 21 17:58:32.442135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 587/1166] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:32 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:33.459633 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-009714cb-7e5d-48a3-b068-e9e7f81e208e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:33.460325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-009714cb-7e5d-48a3-b068-e9e7f81e208e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:33.466936 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-009714cb-7e5d-48a3-b068-e9e7f81e208e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:33.467382 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-009714cb-7e5d-48a3-b068-e9e7f81e208e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:33.468140 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-009714cb-7e5d-48a3-b068-e9e7f81e208e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:33.468598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-009714cb-7e5d-48a3-b068-e9e7f81e208e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:33.529224 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-009714cb-7e5d-48a3-b068-e9e7f81e208e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:33.537152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-009714cb-7e5d-48a3-b068-e9e7f81e208e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081835 Jul 21 17:58:33.537832 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 580/1167] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:33 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:34.554459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8b004648-3052-462c-a68c-f96ead467311 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:34.555012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8b004648-3052-462c-a68c-f96ead467311 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:34.561508 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8b004648-3052-462c-a68c-f96ead467311 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:34.561954 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8b004648-3052-462c-a68c-f96ead467311 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:34.562724 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8b004648-3052-462c-a68c-f96ead467311 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:34.563414 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8b004648-3052-462c-a68c-f96ead467311 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:34.623815 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8b004648-3052-462c-a68c-f96ead467311 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:34.632001 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8b004648-3052-462c-a68c-f96ead467311 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081570 Jul 21 17:58:34.632603 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 588/1168] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:34 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:35.649101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-448d8eb2-da33-49b3-ac3b-7c1503142a33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:35.650108 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-448d8eb2-da33-49b3-ac3b-7c1503142a33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:35.656836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-448d8eb2-da33-49b3-ac3b-7c1503142a33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:35.657294 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-448d8eb2-da33-49b3-ac3b-7c1503142a33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:35.658061 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-448d8eb2-da33-49b3-ac3b-7c1503142a33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:35.658503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-448d8eb2-da33-49b3-ac3b-7c1503142a33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:35.723550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-448d8eb2-da33-49b3-ac3b-7c1503142a33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:35.732240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-448d8eb2-da33-49b3-ac3b-7c1503142a33 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087711 Jul 21 17:58:35.732827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 581/1169] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:35 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:36.748717 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ef1ceccd-9ab6-43e7-9c8e-9b5206fa6f99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:36.749319 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ef1ceccd-9ab6-43e7-9c8e-9b5206fa6f99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:36.756611 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ef1ceccd-9ab6-43e7-9c8e-9b5206fa6f99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:36.757066 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ef1ceccd-9ab6-43e7-9c8e-9b5206fa6f99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:36.757834 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ef1ceccd-9ab6-43e7-9c8e-9b5206fa6f99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:36.758282 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ef1ceccd-9ab6-43e7-9c8e-9b5206fa6f99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:36.819591 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ef1ceccd-9ab6-43e7-9c8e-9b5206fa6f99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:36.827565 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ef1ceccd-9ab6-43e7-9c8e-9b5206fa6f99 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082695 Jul 21 17:58:36.828132 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 589/1170] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:36 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:37.844115 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-63c0083c-bca6-4e9c-86a9-fe07ef170a6f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:37.844751 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-63c0083c-bca6-4e9c-86a9-fe07ef170a6f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:37.851341 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63c0083c-bca6-4e9c-86a9-fe07ef170a6f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:37.851787 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63c0083c-bca6-4e9c-86a9-fe07ef170a6f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:37.852591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63c0083c-bca6-4e9c-86a9-fe07ef170a6f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:37.853033 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63c0083c-bca6-4e9c-86a9-fe07ef170a6f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:37.912987 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-63c0083c-bca6-4e9c-86a9-fe07ef170a6f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:37.920993 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-63c0083c-bca6-4e9c-86a9-fe07ef170a6f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.080778 Jul 21 17:58:37.921564 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 582/1171] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:37 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:38.938248 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9b508975-f552-4a86-ab84-6275fd6acd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:38.938983 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9b508975-f552-4a86-ab84-6275fd6acd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:38.946149 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9b508975-f552-4a86-ab84-6275fd6acd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:38.946905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9b508975-f552-4a86-ab84-6275fd6acd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:38.947952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9b508975-f552-4a86-ab84-6275fd6acd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:38.948461 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9b508975-f552-4a86-ab84-6275fd6acd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:39.012322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9b508975-f552-4a86-ab84-6275fd6acd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:39.020730 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9b508975-f552-4a86-ab84-6275fd6acd26 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086896 Jul 21 17:58:39.021379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 590/1172] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:38 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:40.038417 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3531f80a-ed3a-4ca7-be56-365c7200dbe3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:40.039035 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3531f80a-ed3a-4ca7-be56-365c7200dbe3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:40.045586 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3531f80a-ed3a-4ca7-be56-365c7200dbe3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:40.046045 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3531f80a-ed3a-4ca7-be56-365c7200dbe3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:40.046834 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3531f80a-ed3a-4ca7-be56-365c7200dbe3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:40.047257 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3531f80a-ed3a-4ca7-be56-365c7200dbe3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:40.113266 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3531f80a-ed3a-4ca7-be56-365c7200dbe3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:40.122229 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3531f80a-ed3a-4ca7-be56-365c7200dbe3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.088304 Jul 21 17:58:40.122792 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 583/1173] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:41.139333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cb0273e7-1f18-4efe-aaed-a6b077fa873b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:41.139936 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cb0273e7-1f18-4efe-aaed-a6b077fa873b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:41.147061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb0273e7-1f18-4efe-aaed-a6b077fa873b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:41.147504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb0273e7-1f18-4efe-aaed-a6b077fa873b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:41.148256 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb0273e7-1f18-4efe-aaed-a6b077fa873b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:41.148710 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cb0273e7-1f18-4efe-aaed-a6b077fa873b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:41.209626 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-cb0273e7-1f18-4efe-aaed-a6b077fa873b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:41.217534 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cb0273e7-1f18-4efe-aaed-a6b077fa873b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082022 Jul 21 17:58:41.218086 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 591/1174] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:41 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:42.234170 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-11058402-9f60-4221-b52f-709b3fab3563 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:42.234710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-11058402-9f60-4221-b52f-709b3fab3563 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:42.241880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11058402-9f60-4221-b52f-709b3fab3563 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:42.242329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11058402-9f60-4221-b52f-709b3fab3563 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:42.243099 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11058402-9f60-4221-b52f-709b3fab3563 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:42.243539 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11058402-9f60-4221-b52f-709b3fab3563 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:42.304326 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11058402-9f60-4221-b52f-709b3fab3563 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:42.312170 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-11058402-9f60-4221-b52f-709b3fab3563 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081997 Jul 21 17:58:42.313031 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 584/1175] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:42 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:43.329737 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-520a0821-516b-4362-925b-73e1496b580e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:43.330299 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-520a0821-516b-4362-925b-73e1496b580e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:43.337545 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-520a0821-516b-4362-925b-73e1496b580e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:43.337988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-520a0821-516b-4362-925b-73e1496b580e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:43.338746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-520a0821-516b-4362-925b-73e1496b580e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:43.339180 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-520a0821-516b-4362-925b-73e1496b580e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:43.400023 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-520a0821-516b-4362-925b-73e1496b580e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:43.407868 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-520a0821-516b-4362-925b-73e1496b580e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082124 Jul 21 17:58:43.408445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 592/1176] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:44.425121 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4f5463a1-3c95-4265-9987-2cc0f24d22ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:44.425742 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4f5463a1-3c95-4265-9987-2cc0f24d22ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:44.432966 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4f5463a1-3c95-4265-9987-2cc0f24d22ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:44.433422 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4f5463a1-3c95-4265-9987-2cc0f24d22ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:44.434187 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4f5463a1-3c95-4265-9987-2cc0f24d22ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:44.434626 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4f5463a1-3c95-4265-9987-2cc0f24d22ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:44.499030 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4f5463a1-3c95-4265-9987-2cc0f24d22ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:44.507172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4f5463a1-3c95-4265-9987-2cc0f24d22ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085925 Jul 21 17:58:44.507731 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 585/1177] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:44 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:45.524845 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c2b08076-31d7-4d72-ac9c-cba03fbef458 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:45.525463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c2b08076-31d7-4d72-ac9c-cba03fbef458 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:45.532079 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c2b08076-31d7-4d72-ac9c-cba03fbef458 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:45.532560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c2b08076-31d7-4d72-ac9c-cba03fbef458 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:45.533328 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c2b08076-31d7-4d72-ac9c-cba03fbef458 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:45.533770 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c2b08076-31d7-4d72-ac9c-cba03fbef458 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:45.596558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c2b08076-31d7-4d72-ac9c-cba03fbef458 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:45.604687 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c2b08076-31d7-4d72-ac9c-cba03fbef458 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084804 Jul 21 17:58:45.605247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 593/1178] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:45 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:46.621136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-40876866-f979-4079-a7a7-21461c293dbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:46.621757 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-40876866-f979-4079-a7a7-21461c293dbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:46.628348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40876866-f979-4079-a7a7-21461c293dbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:46.628805 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40876866-f979-4079-a7a7-21461c293dbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:46.629577 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40876866-f979-4079-a7a7-21461c293dbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:46.630021 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40876866-f979-4079-a7a7-21461c293dbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:46.633910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=84 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:58:46.691465 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-40876866-f979-4079-a7a7-21461c293dbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:46.699627 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-40876866-f979-4079-a7a7-21461c293dbc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082392 Jul 21 17:58:46.700189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 586/1179] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:46 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:47.716922 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e38e0da6-e885-45b7-9b42-93e7e121c254 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:47.717543 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e38e0da6-e885-45b7-9b42-93e7e121c254 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:47.724546 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e38e0da6-e885-45b7-9b42-93e7e121c254 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:47.725156 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e38e0da6-e885-45b7-9b42-93e7e121c254 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:47.725931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e38e0da6-e885-45b7-9b42-93e7e121c254 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:47.726372 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e38e0da6-e885-45b7-9b42-93e7e121c254 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:47.788325 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e38e0da6-e885-45b7-9b42-93e7e121c254 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:47.796147 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e38e0da6-e885-45b7-9b42-93e7e121c254 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083082 Jul 21 17:58:47.796816 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 594/1180] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:48.813931 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-30d12776-2896-4961-9617-a9b070e94fc9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:48.814544 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-30d12776-2896-4961-9617-a9b070e94fc9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:48.821840 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-30d12776-2896-4961-9617-a9b070e94fc9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:48.822286 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-30d12776-2896-4961-9617-a9b070e94fc9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:48.823044 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-30d12776-2896-4961-9617-a9b070e94fc9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:48.823506 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-30d12776-2896-4961-9617-a9b070e94fc9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:48.886815 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-30d12776-2896-4961-9617-a9b070e94fc9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:48.894852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-30d12776-2896-4961-9617-a9b070e94fc9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085081 Jul 21 17:58:48.895415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 587/1181] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:48 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:49.911633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-445176b5-2829-452a-823d-92e9a151f919 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:49.912252 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-445176b5-2829-452a-823d-92e9a151f919 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:49.919250 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-445176b5-2829-452a-823d-92e9a151f919 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:49.919704 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-445176b5-2829-452a-823d-92e9a151f919 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:49.920518 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-445176b5-2829-452a-823d-92e9a151f919 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:49.920966 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-445176b5-2829-452a-823d-92e9a151f919 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:49.983597 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-445176b5-2829-452a-823d-92e9a151f919 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:49.991704 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-445176b5-2829-452a-823d-92e9a151f919 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084379 Jul 21 17:58:49.992263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 595/1182] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:49 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:51.009024 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f99082aa-ae5f-45a8-8b85-5a7d1a17f262 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:51.009600 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f99082aa-ae5f-45a8-8b85-5a7d1a17f262 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:51.016156 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f99082aa-ae5f-45a8-8b85-5a7d1a17f262 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:51.016634 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f99082aa-ae5f-45a8-8b85-5a7d1a17f262 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:51.017401 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f99082aa-ae5f-45a8-8b85-5a7d1a17f262 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:51.017836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f99082aa-ae5f-45a8-8b85-5a7d1a17f262 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:51.128814 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f99082aa-ae5f-45a8-8b85-5a7d1a17f262 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:51.138001 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f99082aa-ae5f-45a8-8b85-5a7d1a17f262 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.133479 Jul 21 17:58:51.138573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 588/1183] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:52.155266 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fdc1d22c-9688-4a90-a6b9-1b53c8449c83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:52.155931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fdc1d22c-9688-4a90-a6b9-1b53c8449c83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:52.163123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fdc1d22c-9688-4a90-a6b9-1b53c8449c83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:52.163631 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fdc1d22c-9688-4a90-a6b9-1b53c8449c83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:52.164515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fdc1d22c-9688-4a90-a6b9-1b53c8449c83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:52.165000 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fdc1d22c-9688-4a90-a6b9-1b53c8449c83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:52.228214 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-fdc1d22c-9688-4a90-a6b9-1b53c8449c83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:52.236241 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fdc1d22c-9688-4a90-a6b9-1b53c8449c83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084897 Jul 21 17:58:52.236823 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 596/1184] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:52 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:58:53.253449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d97fcfcf-affe-4b3d-b1f7-2d9eb8e036ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:53.254075 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d97fcfcf-affe-4b3d-b1f7-2d9eb8e036ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:53.256739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=28 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:58:53.262356 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d97fcfcf-affe-4b3d-b1f7-2d9eb8e036ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:53.262596 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d97fcfcf-affe-4b3d-b1f7-2d9eb8e036ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:53.263355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d97fcfcf-affe-4b3d-b1f7-2d9eb8e036ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:53.263792 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d97fcfcf-affe-4b3d-b1f7-2d9eb8e036ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:53.330397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d97fcfcf-affe-4b3d-b1f7-2d9eb8e036ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:53.339427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d97fcfcf-affe-4b3d-b1f7-2d9eb8e036ed tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.089854 Jul 21 17:58:53.339992 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 589/1185] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:53 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:54.359058 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-76d03352-e210-44bc-92c7-0064df621d55 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:54.359621 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-76d03352-e210-44bc-92c7-0064df621d55 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:54.362143 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=28 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:58:54.368799 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-76d03352-e210-44bc-92c7-0064df621d55 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:54.369253 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-76d03352-e210-44bc-92c7-0064df621d55 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:54.370017 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-76d03352-e210-44bc-92c7-0064df621d55 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:54.370452 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-76d03352-e210-44bc-92c7-0064df621d55 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:54.374491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=84 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:58:54.432957 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-76d03352-e210-44bc-92c7-0064df621d55 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:54.441070 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-76d03352-e210-44bc-92c7-0064df621d55 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086251 Jul 21 17:58:54.441632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 597/1186] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:54 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:55.458415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6f8e78ee-797b-4525-b62d-46aa5d85a67e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:55.459023 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6f8e78ee-797b-4525-b62d-46aa5d85a67e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:55.465643 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f8e78ee-797b-4525-b62d-46aa5d85a67e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:55.466094 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f8e78ee-797b-4525-b62d-46aa5d85a67e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:55.466857 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f8e78ee-797b-4525-b62d-46aa5d85a67e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:55.467293 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f8e78ee-797b-4525-b62d-46aa5d85a67e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:55.528908 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6f8e78ee-797b-4525-b62d-46aa5d85a67e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:55.536956 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6f8e78ee-797b-4525-b62d-46aa5d85a67e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082536 Jul 21 17:58:55.537533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 590/1187] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:55 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:56.555992 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3ddf4e1f-935c-46b1-83ce-bc135a6e5bb6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:56.556677 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3ddf4e1f-935c-46b1-83ce-bc135a6e5bb6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:56.563885 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3ddf4e1f-935c-46b1-83ce-bc135a6e5bb6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:56.564370 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3ddf4e1f-935c-46b1-83ce-bc135a6e5bb6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:56.565141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3ddf4e1f-935c-46b1-83ce-bc135a6e5bb6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:56.565584 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3ddf4e1f-935c-46b1-83ce-bc135a6e5bb6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:56.627404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3ddf4e1f-935c-46b1-83ce-bc135a6e5bb6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:56.636048 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3ddf4e1f-935c-46b1-83ce-bc135a6e5bb6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084829 Jul 21 17:58:56.636658 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 598/1188] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:56 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:57.652879 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b8fa2d5e-c0ac-4b71-a7e4-a8310b771ae5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:57.653496 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b8fa2d5e-c0ac-4b71-a7e4-a8310b771ae5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:57.660004 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8fa2d5e-c0ac-4b71-a7e4-a8310b771ae5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:57.660501 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8fa2d5e-c0ac-4b71-a7e4-a8310b771ae5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:57.661987 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8fa2d5e-c0ac-4b71-a7e4-a8310b771ae5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:57.662430 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b8fa2d5e-c0ac-4b71-a7e4-a8310b771ae5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:57.728498 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b8fa2d5e-c0ac-4b71-a7e4-a8310b771ae5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:57.736643 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b8fa2d5e-c0ac-4b71-a7e4-a8310b771ae5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087600 Jul 21 17:58:57.737211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 591/1189] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:57 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:58:58.754196 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1636d814-7637-4432-9034-011b5f4ca8cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:58.754810 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1636d814-7637-4432-9034-011b5f4ca8cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:58.761441 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1636d814-7637-4432-9034-011b5f4ca8cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:58.761898 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1636d814-7637-4432-9034-011b5f4ca8cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:58.762655 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1636d814-7637-4432-9034-011b5f4ca8cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:58.763093 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1636d814-7637-4432-9034-011b5f4ca8cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:58.825187 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1636d814-7637-4432-9034-011b5f4ca8cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:58.833152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1636d814-7637-4432-9034-011b5f4ca8cb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082851 Jul 21 17:58:58.833718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 599/1190] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:58 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:58:59.850627 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-140de9e5-fdb0-4e44-8e58-6f259e2dff28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:58:59.851751 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-140de9e5-fdb0-4e44-8e58-6f259e2dff28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:58:59.857924 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-140de9e5-fdb0-4e44-8e58-6f259e2dff28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:59.858376 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-140de9e5-fdb0-4e44-8e58-6f259e2dff28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:59.859143 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-140de9e5-fdb0-4e44-8e58-6f259e2dff28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:58:59.859581 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-140de9e5-fdb0-4e44-8e58-6f259e2dff28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:58:59.924949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-140de9e5-fdb0-4e44-8e58-6f259e2dff28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:58:59.933634 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-140de9e5-fdb0-4e44-8e58-6f259e2dff28 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086861 Jul 21 17:58:59.934208 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 592/1191] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:58:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:00.951522 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-20eecb38-5558-4d52-a064-eb8fd09e0dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:00.952065 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-20eecb38-5558-4d52-a064-eb8fd09e0dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:00.958122 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-20eecb38-5558-4d52-a064-eb8fd09e0dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:00.958618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-20eecb38-5558-4d52-a064-eb8fd09e0dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:00.959434 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-20eecb38-5558-4d52-a064-eb8fd09e0dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:00.959898 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-20eecb38-5558-4d52-a064-eb8fd09e0dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:01.028419 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-20eecb38-5558-4d52-a064-eb8fd09e0dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:01.036337 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-20eecb38-5558-4d52-a064-eb8fd09e0dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.088854 Jul 21 17:59:01.036924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 600/1192] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:01.310586 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-1f296d73-f072-4c75-9ed8-a12f0af49377 req-22f29bd8-4407-4f21-9e2c-7a7ee0a469ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14c1a66-269c-4e3f-95f6-6388fe5c16c1", "name": "network-vif-deleted", "tag": "0e9ac75f-bb94-463e-bd6c-b7d141769a5c"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 17:59:01.319463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-1f296d73-f072-4c75-9ed8-a12f0af49377 req-22f29bd8-4407-4f21-9e2c-7a7ee0a469ff service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:01.319920 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-1f296d73-f072-4c75-9ed8-a12f0af49377 req-22f29bd8-4407-4f21-9e2c-7a7ee0a469ff service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:01.331138 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-1f296d73-f072-4c75-9ed8-a12f0af49377 req-22f29bd8-4407-4f21-9e2c-7a7ee0a469ff service nova] Creating event network-vif-deleted:0e9ac75f-bb94-463e-bd6c-b7d141769a5c for instance e14c1a66-269c-4e3f-95f6-6388fe5c16c1 on hv-cinder-82549 Jul 21 17:59:01.334723 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [req-1f296d73-f072-4c75-9ed8-a12f0af49377 req-22f29bd8-4407-4f21-9e2c-7a7ee0a469ff service nova] [3cabb5b5-9136-4aa2-b570-e48b07ce9389] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 17:59:02.053413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b059473b-27ef-4ea8-93b6-068c1b2506f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:02.055096 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b059473b-27ef-4ea8-93b6-068c1b2506f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:02.062682 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b059473b-27ef-4ea8-93b6-068c1b2506f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:02.063140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b059473b-27ef-4ea8-93b6-068c1b2506f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:02.063944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b059473b-27ef-4ea8-93b6-068c1b2506f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:02.064419 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b059473b-27ef-4ea8-93b6-068c1b2506f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:02.133537 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b059473b-27ef-4ea8-93b6-068c1b2506f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:02.141493 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b059473b-27ef-4ea8-93b6-068c1b2506f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.092196 Jul 21 17:59:02.142058 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 601/1193] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:59:02.342640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [req-1f296d73-f072-4c75-9ed8-a12f0af49377 req-22f29bd8-4407-4f21-9e2c-7a7ee0a469ff service nova] [3cabb5b5-9136-4aa2-b570-e48b07ce9389] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 42224. Jul 21 17:59:02.346230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-1f296d73-f072-4c75-9ed8-a12f0af49377 req-22f29bd8-4407-4f21-9e2c-7a7ee0a469ff service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.039484 Jul 21 17:59:02.346876 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 593/1194] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 17:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 17:59:03.160750 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-313dfa12-2a2d-4fad-adba-a30c5422352b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:03.161372 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-313dfa12-2a2d-4fad-adba-a30c5422352b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:03.169774 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-313dfa12-2a2d-4fad-adba-a30c5422352b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:03.170232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-313dfa12-2a2d-4fad-adba-a30c5422352b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:03.171307 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-313dfa12-2a2d-4fad-adba-a30c5422352b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:03.171774 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-313dfa12-2a2d-4fad-adba-a30c5422352b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:03.236189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-313dfa12-2a2d-4fad-adba-a30c5422352b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:03.244515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-313dfa12-2a2d-4fad-adba-a30c5422352b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087552 Jul 21 17:59:03.245079 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 602/1195] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:03 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:04.265119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-aaf5f8a3-690d-49ff-a687-d7245fcd447e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:04.265733 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-aaf5f8a3-690d-49ff-a687-d7245fcd447e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:04.272008 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aaf5f8a3-690d-49ff-a687-d7245fcd447e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:04.272997 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aaf5f8a3-690d-49ff-a687-d7245fcd447e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:04.273837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aaf5f8a3-690d-49ff-a687-d7245fcd447e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:04.274273 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aaf5f8a3-690d-49ff-a687-d7245fcd447e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:04.341220 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-aaf5f8a3-690d-49ff-a687-d7245fcd447e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:04.349218 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-aaf5f8a3-690d-49ff-a687-d7245fcd447e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.088892 Jul 21 17:59:04.349787 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 594/1196] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:04 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:05.367612 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5e0c457a-2c4f-4bbe-bf3a-a756f3902ef2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:05.368231 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5e0c457a-2c4f-4bbe-bf3a-a756f3902ef2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:05.374647 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5e0c457a-2c4f-4bbe-bf3a-a756f3902ef2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:05.375100 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5e0c457a-2c4f-4bbe-bf3a-a756f3902ef2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:05.375845 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5e0c457a-2c4f-4bbe-bf3a-a756f3902ef2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:05.376277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5e0c457a-2c4f-4bbe-bf3a-a756f3902ef2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:05.441376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5e0c457a-2c4f-4bbe-bf3a-a756f3902ef2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:05.449318 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5e0c457a-2c4f-4bbe-bf3a-a756f3902ef2 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086374 Jul 21 17:59:05.449879 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 603/1197] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:05.852392 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:59:05.853001 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 17:59:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:59:06.466745 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bb55f820-acbd-456e-a981-839b71858f09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:06.467370 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bb55f820-acbd-456e-a981-839b71858f09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:06.474039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb55f820-acbd-456e-a981-839b71858f09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:06.474487 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb55f820-acbd-456e-a981-839b71858f09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:06.475253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb55f820-acbd-456e-a981-839b71858f09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:06.476166 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb55f820-acbd-456e-a981-839b71858f09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:06.542349 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bb55f820-acbd-456e-a981-839b71858f09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:06.550284 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bb55f820-acbd-456e-a981-839b71858f09 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087434 Jul 21 17:59:06.550851 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 595/1198] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:06 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:07.568683 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ffa26dab-0ffd-431a-a599-a709f48f1fbd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:07.569283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ffa26dab-0ffd-431a-a599-a709f48f1fbd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:07.575785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ffa26dab-0ffd-431a-a599-a709f48f1fbd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:07.576232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ffa26dab-0ffd-431a-a599-a709f48f1fbd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:07.577014 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ffa26dab-0ffd-431a-a599-a709f48f1fbd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:07.577446 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ffa26dab-0ffd-431a-a599-a709f48f1fbd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:07.637769 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ffa26dab-0ffd-431a-a599-a709f48f1fbd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:07.645535 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ffa26dab-0ffd-431a-a599-a709f48f1fbd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.080667 Jul 21 17:59:07.646094 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 604/1199] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:07 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:08.662662 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d42452a7-3666-4fe4-8a87-046ff82b81a6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:08.663989 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d42452a7-3666-4fe4-8a87-046ff82b81a6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:08.670650 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d42452a7-3666-4fe4-8a87-046ff82b81a6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:08.671101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d42452a7-3666-4fe4-8a87-046ff82b81a6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:08.671865 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d42452a7-3666-4fe4-8a87-046ff82b81a6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:08.672319 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d42452a7-3666-4fe4-8a87-046ff82b81a6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:08.733544 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d42452a7-3666-4fe4-8a87-046ff82b81a6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:08.742150 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d42452a7-3666-4fe4-8a87-046ff82b81a6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083360 Jul 21 17:59:08.742710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 596/1200] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:09.759788 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5235b7f0-ca7a-42b9-98c8-321dc2222ea9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:09.760424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5235b7f0-ca7a-42b9-98c8-321dc2222ea9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:09.766883 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5235b7f0-ca7a-42b9-98c8-321dc2222ea9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:09.767335 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5235b7f0-ca7a-42b9-98c8-321dc2222ea9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:09.768088 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5235b7f0-ca7a-42b9-98c8-321dc2222ea9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:09.768552 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5235b7f0-ca7a-42b9-98c8-321dc2222ea9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:09.831411 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5235b7f0-ca7a-42b9-98c8-321dc2222ea9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:09.839576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5235b7f0-ca7a-42b9-98c8-321dc2222ea9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084321 Jul 21 17:59:09.840138 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 605/1201] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:10.856434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-90379fd4-1b9d-4a78-8a44-aabeac0ca18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:10.857051 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-90379fd4-1b9d-4a78-8a44-aabeac0ca18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:10.863602 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90379fd4-1b9d-4a78-8a44-aabeac0ca18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:10.864055 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90379fd4-1b9d-4a78-8a44-aabeac0ca18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:10.864862 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90379fd4-1b9d-4a78-8a44-aabeac0ca18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:10.865301 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90379fd4-1b9d-4a78-8a44-aabeac0ca18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:10.930290 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-90379fd4-1b9d-4a78-8a44-aabeac0ca18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:10.938578 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-90379fd4-1b9d-4a78-8a44-aabeac0ca18c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086029 Jul 21 17:59:10.939141 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 597/1202] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:10 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:11.955032 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8d00f3a4-2d1c-4811-93a1-4b7127c55ef1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:11.955645 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8d00f3a4-2d1c-4811-93a1-4b7127c55ef1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:11.962250 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8d00f3a4-2d1c-4811-93a1-4b7127c55ef1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:11.962698 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8d00f3a4-2d1c-4811-93a1-4b7127c55ef1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:11.963453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8d00f3a4-2d1c-4811-93a1-4b7127c55ef1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:11.963885 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8d00f3a4-2d1c-4811-93a1-4b7127c55ef1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:12.023815 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8d00f3a4-2d1c-4811-93a1-4b7127c55ef1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:12.031664 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8d00f3a4-2d1c-4811-93a1-4b7127c55ef1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.080540 Jul 21 17:59:12.032225 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 606/1203] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:11 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:13.048834 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-79a755d0-0d84-4120-8477-e0da3caaba1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:13.049387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-79a755d0-0d84-4120-8477-e0da3caaba1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:13.056276 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79a755d0-0d84-4120-8477-e0da3caaba1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:13.056758 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79a755d0-0d84-4120-8477-e0da3caaba1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:13.057535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79a755d0-0d84-4120-8477-e0da3caaba1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:13.057981 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-79a755d0-0d84-4120-8477-e0da3caaba1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:13.120021 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-79a755d0-0d84-4120-8477-e0da3caaba1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:13.128005 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-79a755d0-0d84-4120-8477-e0da3caaba1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083194 Jul 21 17:59:13.128609 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 598/1204] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:13.915182 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:59:13.915797 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 17:59:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:59:14.144880 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a5878161-faad-4e56-a746-e501e543c57a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:14.145519 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a5878161-faad-4e56-a746-e501e543c57a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:14.151988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a5878161-faad-4e56-a746-e501e543c57a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:14.152475 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a5878161-faad-4e56-a746-e501e543c57a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:14.153232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a5878161-faad-4e56-a746-e501e543c57a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:14.153666 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a5878161-faad-4e56-a746-e501e543c57a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:14.217903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a5878161-faad-4e56-a746-e501e543c57a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:14.225888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a5878161-faad-4e56-a746-e501e543c57a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084933 Jul 21 17:59:14.226438 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 607/1205] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:14 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:15.373999 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2e909574-7666-4dcc-8591-143d1042bdec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:15.374628 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2e909574-7666-4dcc-8591-143d1042bdec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:15.380727 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2e909574-7666-4dcc-8591-143d1042bdec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:15.381685 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2e909574-7666-4dcc-8591-143d1042bdec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:15.382462 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2e909574-7666-4dcc-8591-143d1042bdec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:15.382908 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2e909574-7666-4dcc-8591-143d1042bdec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:15.447002 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2e909574-7666-4dcc-8591-143d1042bdec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:15.455044 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2e909574-7666-4dcc-8591-143d1042bdec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.216542 Jul 21 17:59:15.455804 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 599/1206] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:16.472680 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5f908ce4-2b0f-40ed-8340-80645849e4f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:16.473295 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5f908ce4-2b0f-40ed-8340-80645849e4f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:16.480379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5f908ce4-2b0f-40ed-8340-80645849e4f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:16.480832 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5f908ce4-2b0f-40ed-8340-80645849e4f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:16.481580 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5f908ce4-2b0f-40ed-8340-80645849e4f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:16.482015 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5f908ce4-2b0f-40ed-8340-80645849e4f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:16.542729 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5f908ce4-2b0f-40ed-8340-80645849e4f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:16.550592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5f908ce4-2b0f-40ed-8340-80645849e4f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081729 Jul 21 17:59:16.551145 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 608/1207] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:16 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:17.567165 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bf71bd5c-9f05-43e0-9dbf-9f84aa7520e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:17.567785 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bf71bd5c-9f05-43e0-9dbf-9f84aa7520e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:17.575470 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf71bd5c-9f05-43e0-9dbf-9f84aa7520e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:17.575927 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf71bd5c-9f05-43e0-9dbf-9f84aa7520e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:17.576729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf71bd5c-9f05-43e0-9dbf-9f84aa7520e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:17.577171 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf71bd5c-9f05-43e0-9dbf-9f84aa7520e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:17.581079 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=80 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:59:17.638665 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bf71bd5c-9f05-43e0-9dbf-9f84aa7520e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:17.647391 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bf71bd5c-9f05-43e0-9dbf-9f84aa7520e4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083459 Jul 21 17:59:17.647947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 600/1208] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:17 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:18.044979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:59:18.045167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 17:59:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:59:18.080857 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:59:18.081325 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 17:59:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:59:18.664798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-285b4218-d0f6-45a2-82a8-d11afbd4badb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:18.665417 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-285b4218-d0f6-45a2-82a8-d11afbd4badb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:18.672175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-285b4218-d0f6-45a2-82a8-d11afbd4badb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:18.672674 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-285b4218-d0f6-45a2-82a8-d11afbd4badb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:18.673444 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-285b4218-d0f6-45a2-82a8-d11afbd4badb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:18.673887 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-285b4218-d0f6-45a2-82a8-d11afbd4badb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:18.735493 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-285b4218-d0f6-45a2-82a8-d11afbd4badb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:18.743694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-285b4218-d0f6-45a2-82a8-d11afbd4badb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083466 Jul 21 17:59:18.744254 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 609/1209] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:18 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:19.760576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ff774298-903c-4474-8ac3-c0f0c8b4c241 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:19.761159 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ff774298-903c-4474-8ac3-c0f0c8b4c241 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:19.767907 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff774298-903c-4474-8ac3-c0f0c8b4c241 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:19.768389 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff774298-903c-4474-8ac3-c0f0c8b4c241 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:19.769152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff774298-903c-4474-8ac3-c0f0c8b4c241 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:19.769663 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff774298-903c-4474-8ac3-c0f0c8b4c241 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:19.836211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ff774298-903c-4474-8ac3-c0f0c8b4c241 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:19.844818 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ff774298-903c-4474-8ac3-c0f0c8b4c241 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.088774 Jul 21 17:59:19.845373 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 601/1210] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:19 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:20.862289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7fe9a5d2-892b-4877-a7ca-00333f342eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:20.862882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7fe9a5d2-892b-4877-a7ca-00333f342eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:20.869517 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fe9a5d2-892b-4877-a7ca-00333f342eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:20.869993 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fe9a5d2-892b-4877-a7ca-00333f342eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:20.870759 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fe9a5d2-892b-4877-a7ca-00333f342eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:20.871191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7fe9a5d2-892b-4877-a7ca-00333f342eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:20.935210 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7fe9a5d2-892b-4877-a7ca-00333f342eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:20.943796 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7fe9a5d2-892b-4877-a7ca-00333f342eec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085253 Jul 21 17:59:20.944546 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 610/1211] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:20 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:21.960732 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a98734ba-1ffc-4d8b-8e54-ba859b52c3a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:21.961342 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a98734ba-1ffc-4d8b-8e54-ba859b52c3a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:21.967767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a98734ba-1ffc-4d8b-8e54-ba859b52c3a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:21.968211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a98734ba-1ffc-4d8b-8e54-ba859b52c3a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:21.968998 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a98734ba-1ffc-4d8b-8e54-ba859b52c3a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:21.969436 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a98734ba-1ffc-4d8b-8e54-ba859b52c3a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:22.030426 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a98734ba-1ffc-4d8b-8e54-ba859b52c3a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:22.039002 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a98734ba-1ffc-4d8b-8e54-ba859b52c3a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082072 Jul 21 17:59:22.039688 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 602/1212] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:23.056083 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-25832c52-f112-4573-80d1-ee5c406db9a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:23.056641 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-25832c52-f112-4573-80d1-ee5c406db9a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:23.063406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25832c52-f112-4573-80d1-ee5c406db9a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:23.063857 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25832c52-f112-4573-80d1-ee5c406db9a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:23.064652 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25832c52-f112-4573-80d1-ee5c406db9a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:23.065093 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25832c52-f112-4573-80d1-ee5c406db9a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:23.127595 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-25832c52-f112-4573-80d1-ee5c406db9a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:23.136754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-25832c52-f112-4573-80d1-ee5c406db9a0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085693 Jul 21 17:59:23.137323 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 611/1213] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:23 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:24.153747 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-458f6928-9147-4a66-b7a9-90266b8cbc14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:24.154361 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-458f6928-9147-4a66-b7a9-90266b8cbc14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:24.156718 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=28 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:59:24.163357 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-458f6928-9147-4a66-b7a9-90266b8cbc14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:24.163821 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-458f6928-9147-4a66-b7a9-90266b8cbc14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:24.164645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-458f6928-9147-4a66-b7a9-90266b8cbc14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:24.165086 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-458f6928-9147-4a66-b7a9-90266b8cbc14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:24.229605 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-458f6928-9147-4a66-b7a9-90266b8cbc14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:24.237659 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-458f6928-9147-4a66-b7a9-90266b8cbc14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.088007 Jul 21 17:59:24.238444 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 603/1214] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:24 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:25.254536 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3879160a-5fef-4ed9-8f2d-b4d16dd37697 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:25.255154 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3879160a-5fef-4ed9-8f2d-b4d16dd37697 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:25.257622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=30 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:59:25.263024 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3879160a-5fef-4ed9-8f2d-b4d16dd37697 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:25.263474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3879160a-5fef-4ed9-8f2d-b4d16dd37697 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:25.264237 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3879160a-5fef-4ed9-8f2d-b4d16dd37697 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:25.264699 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3879160a-5fef-4ed9-8f2d-b4d16dd37697 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:25.268593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=90 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:59:25.325524 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3879160a-5fef-4ed9-8f2d-b4d16dd37697 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:25.333382 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3879160a-5fef-4ed9-8f2d-b4d16dd37697 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082760 Jul 21 17:59:25.334468 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 612/1215] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:25 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:26.350757 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-18bc4cdc-a504-4f12-b576-a79347e13c1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:26.351399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-18bc4cdc-a504-4f12-b576-a79347e13c1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:26.357858 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18bc4cdc-a504-4f12-b576-a79347e13c1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:26.358309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18bc4cdc-a504-4f12-b576-a79347e13c1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:26.359064 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18bc4cdc-a504-4f12-b576-a79347e13c1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:26.359500 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18bc4cdc-a504-4f12-b576-a79347e13c1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:26.420468 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-18bc4cdc-a504-4f12-b576-a79347e13c1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:26.429137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-18bc4cdc-a504-4f12-b576-a79347e13c1f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082248 Jul 21 17:59:26.429729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 604/1216] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:26 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:27.446822 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-89326410-e72f-4ba3-ae7d-597a6033d616 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:27.447466 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-89326410-e72f-4ba3-ae7d-597a6033d616 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:27.453966 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-89326410-e72f-4ba3-ae7d-597a6033d616 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:27.454418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-89326410-e72f-4ba3-ae7d-597a6033d616 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:27.455212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-89326410-e72f-4ba3-ae7d-597a6033d616 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:27.455649 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-89326410-e72f-4ba3-ae7d-597a6033d616 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:27.518459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-89326410-e72f-4ba3-ae7d-597a6033d616 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:27.526883 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-89326410-e72f-4ba3-ae7d-597a6033d616 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084570 Jul 21 17:59:27.527446 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 613/1217] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:27 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:28.544259 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-799c1d88-7880-4887-b3b9-9127bf0068b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:28.545256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-799c1d88-7880-4887-b3b9-9127bf0068b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:28.552070 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-799c1d88-7880-4887-b3b9-9127bf0068b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:28.552946 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-799c1d88-7880-4887-b3b9-9127bf0068b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:28.553854 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-799c1d88-7880-4887-b3b9-9127bf0068b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:28.554503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-799c1d88-7880-4887-b3b9-9127bf0068b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:28.625332 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-799c1d88-7880-4887-b3b9-9127bf0068b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:28.636845 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-799c1d88-7880-4887-b3b9-9127bf0068b9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.096877 Jul 21 17:59:28.637428 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 605/1218] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:28 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:29.656595 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0473c3df-c1c9-4842-8e14-b72941d90cfb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:29.657210 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0473c3df-c1c9-4842-8e14-b72941d90cfb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:29.664407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0473c3df-c1c9-4842-8e14-b72941d90cfb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:29.664862 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0473c3df-c1c9-4842-8e14-b72941d90cfb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:29.665625 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0473c3df-c1c9-4842-8e14-b72941d90cfb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:29.666063 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0473c3df-c1c9-4842-8e14-b72941d90cfb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:29.727045 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0473c3df-c1c9-4842-8e14-b72941d90cfb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:29.734947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0473c3df-c1c9-4842-8e14-b72941d90cfb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082391 Jul 21 17:59:29.735504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 614/1219] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:29 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:30.752182 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-80099457-423f-4f53-95cd-93cadf1e0854 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:30.752821 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-80099457-423f-4f53-95cd-93cadf1e0854 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:30.759984 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-80099457-423f-4f53-95cd-93cadf1e0854 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:30.760463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-80099457-423f-4f53-95cd-93cadf1e0854 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:30.761223 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-80099457-423f-4f53-95cd-93cadf1e0854 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:30.761657 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-80099457-423f-4f53-95cd-93cadf1e0854 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:30.823494 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-80099457-423f-4f53-95cd-93cadf1e0854 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:30.831550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-80099457-423f-4f53-95cd-93cadf1e0854 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083268 Jul 21 17:59:30.832107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 606/1220] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:30 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:31.577190 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 17:59:31.577750 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 17:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 17:59:31.848888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b5a3a4d8-d4bb-4823-8ed9-81cffc383d14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:31.849469 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b5a3a4d8-d4bb-4823-8ed9-81cffc383d14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:31.855514 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b5a3a4d8-d4bb-4823-8ed9-81cffc383d14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:31.855961 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b5a3a4d8-d4bb-4823-8ed9-81cffc383d14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:31.856751 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b5a3a4d8-d4bb-4823-8ed9-81cffc383d14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:31.857190 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b5a3a4d8-d4bb-4823-8ed9-81cffc383d14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:31.918771 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b5a3a4d8-d4bb-4823-8ed9-81cffc383d14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:31.926787 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b5a3a4d8-d4bb-4823-8ed9-81cffc383d14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081924 Jul 21 17:59:31.927363 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 615/1221] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:32.943858 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-91ad5743-8ccc-4e63-8d1a-a9bdec10cd7d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:32.944556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-91ad5743-8ccc-4e63-8d1a-a9bdec10cd7d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:32.951515 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91ad5743-8ccc-4e63-8d1a-a9bdec10cd7d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:32.951964 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91ad5743-8ccc-4e63-8d1a-a9bdec10cd7d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:32.952769 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91ad5743-8ccc-4e63-8d1a-a9bdec10cd7d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:32.953200 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91ad5743-8ccc-4e63-8d1a-a9bdec10cd7d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:33.019567 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-91ad5743-8ccc-4e63-8d1a-a9bdec10cd7d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:33.028823 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-91ad5743-8ccc-4e63-8d1a-a9bdec10cd7d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.089534 Jul 21 17:59:33.029394 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 607/1222] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:32 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:34.047203 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-baf39825-d7d2-485d-926e-ca6924021f1d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:34.047824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-baf39825-d7d2-485d-926e-ca6924021f1d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:34.055279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-baf39825-d7d2-485d-926e-ca6924021f1d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:34.055607 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-baf39825-d7d2-485d-926e-ca6924021f1d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:34.056404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-baf39825-d7d2-485d-926e-ca6924021f1d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:34.056841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-baf39825-d7d2-485d-926e-ca6924021f1d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:34.119554 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-baf39825-d7d2-485d-926e-ca6924021f1d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:34.127461 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-baf39825-d7d2-485d-926e-ca6924021f1d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084426 Jul 21 17:59:34.128051 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 616/1223] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:34 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:35.144034 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-996ed53a-33df-4e69-aee5-de38551e21d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:35.144715 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-996ed53a-33df-4e69-aee5-de38551e21d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:35.151561 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-996ed53a-33df-4e69-aee5-de38551e21d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:35.152007 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-996ed53a-33df-4e69-aee5-de38551e21d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:35.152906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-996ed53a-33df-4e69-aee5-de38551e21d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:35.153381 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-996ed53a-33df-4e69-aee5-de38551e21d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:35.217318 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-996ed53a-33df-4e69-aee5-de38551e21d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:35.225726 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-996ed53a-33df-4e69-aee5-de38551e21d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085748 Jul 21 17:59:35.226268 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 608/1224] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:35 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 17:59:36.243550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6ce1b732-4f76-4ce7-86a6-8378eebcbf68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:36.244225 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6ce1b732-4f76-4ce7-86a6-8378eebcbf68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:36.250888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ce1b732-4f76-4ce7-86a6-8378eebcbf68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:36.251662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ce1b732-4f76-4ce7-86a6-8378eebcbf68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:36.252524 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ce1b732-4f76-4ce7-86a6-8378eebcbf68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:36.253010 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ce1b732-4f76-4ce7-86a6-8378eebcbf68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:36.318087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6ce1b732-4f76-4ce7-86a6-8378eebcbf68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:36.327076 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6ce1b732-4f76-4ce7-86a6-8378eebcbf68 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.088045 Jul 21 17:59:36.327639 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 617/1225] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:36 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:37.347848 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2bf36f98-e9d0-4185-adf7-edd2f673bf78 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:37.348486 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2bf36f98-e9d0-4185-adf7-edd2f673bf78 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:37.355703 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2bf36f98-e9d0-4185-adf7-edd2f673bf78 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:37.356151 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2bf36f98-e9d0-4185-adf7-edd2f673bf78 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:37.356939 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2bf36f98-e9d0-4185-adf7-edd2f673bf78 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:37.357400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2bf36f98-e9d0-4185-adf7-edd2f673bf78 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:37.421571 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2bf36f98-e9d0-4185-adf7-edd2f673bf78 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:37.429565 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2bf36f98-e9d0-4185-adf7-edd2f673bf78 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085445 Jul 21 17:59:37.430123 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 609/1226] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:37 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:38.447128 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f5d12017-8698-4830-a332-02b08e1a0ab4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:38.447742 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f5d12017-8698-4830-a332-02b08e1a0ab4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:38.454317 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f5d12017-8698-4830-a332-02b08e1a0ab4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:38.454764 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f5d12017-8698-4830-a332-02b08e1a0ab4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:38.455523 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f5d12017-8698-4830-a332-02b08e1a0ab4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:38.455958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f5d12017-8698-4830-a332-02b08e1a0ab4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:38.516286 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f5d12017-8698-4830-a332-02b08e1a0ab4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:38.524171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f5d12017-8698-4830-a332-02b08e1a0ab4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081490 Jul 21 17:59:38.524771 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 618/1227] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:38 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:39.541331 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2d3ab11c-e4a6-4130-ba1c-93f8e83e982f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:39.541948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2d3ab11c-e4a6-4130-ba1c-93f8e83e982f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:39.548556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d3ab11c-e4a6-4130-ba1c-93f8e83e982f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:39.549003 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d3ab11c-e4a6-4130-ba1c-93f8e83e982f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:39.549762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d3ab11c-e4a6-4130-ba1c-93f8e83e982f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:39.550196 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d3ab11c-e4a6-4130-ba1c-93f8e83e982f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:39.615674 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2d3ab11c-e4a6-4130-ba1c-93f8e83e982f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:39.623688 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2d3ab11c-e4a6-4130-ba1c-93f8e83e982f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087608 Jul 21 17:59:39.624438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 610/1228] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:39 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:40.641987 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bbb79def-c922-47c2-bb33-d6bf3f25709f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:40.642607 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bbb79def-c922-47c2-bb33-d6bf3f25709f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:40.650073 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bbb79def-c922-47c2-bb33-d6bf3f25709f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:40.650529 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bbb79def-c922-47c2-bb33-d6bf3f25709f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:40.651298 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bbb79def-c922-47c2-bb33-d6bf3f25709f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:40.651743 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bbb79def-c922-47c2-bb33-d6bf3f25709f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:40.715550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-bbb79def-c922-47c2-bb33-d6bf3f25709f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:40.723507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bbb79def-c922-47c2-bb33-d6bf3f25709f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085420 Jul 21 17:59:40.724062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 619/1229] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:41.743723 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-11a12fe5-6840-4204-9892-a19ae23999f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:41.744538 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-11a12fe5-6840-4204-9892-a19ae23999f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:41.752110 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11a12fe5-6840-4204-9892-a19ae23999f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:41.752595 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11a12fe5-6840-4204-9892-a19ae23999f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:41.753355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11a12fe5-6840-4204-9892-a19ae23999f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:41.753790 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11a12fe5-6840-4204-9892-a19ae23999f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:41.822033 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11a12fe5-6840-4204-9892-a19ae23999f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:41.830823 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-11a12fe5-6840-4204-9892-a19ae23999f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.093874 Jul 21 17:59:41.831385 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 611/1230] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:41 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:42.847164 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-df79b5d8-8262-43f3-ae2c-66624e7cbdc8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:42.847771 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-df79b5d8-8262-43f3-ae2c-66624e7cbdc8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:42.854840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df79b5d8-8262-43f3-ae2c-66624e7cbdc8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:42.855297 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df79b5d8-8262-43f3-ae2c-66624e7cbdc8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:42.856108 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df79b5d8-8262-43f3-ae2c-66624e7cbdc8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:42.856558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df79b5d8-8262-43f3-ae2c-66624e7cbdc8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:42.916473 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-df79b5d8-8262-43f3-ae2c-66624e7cbdc8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:42.924403 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-df79b5d8-8262-43f3-ae2c-66624e7cbdc8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081151 Jul 21 17:59:42.924968 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 620/1231] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:42 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:43.942205 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-debe9529-403a-4ff6-94d9-6ea670c5eee9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:43.942869 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-debe9529-403a-4ff6-94d9-6ea670c5eee9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:43.951287 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-debe9529-403a-4ff6-94d9-6ea670c5eee9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:43.951735 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-debe9529-403a-4ff6-94d9-6ea670c5eee9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:43.952538 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-debe9529-403a-4ff6-94d9-6ea670c5eee9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:43.953013 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-debe9529-403a-4ff6-94d9-6ea670c5eee9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:44.017913 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-debe9529-403a-4ff6-94d9-6ea670c5eee9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:44.027557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-debe9529-403a-4ff6-94d9-6ea670c5eee9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.089178 Jul 21 17:59:44.028129 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 612/1232] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:45.044949 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2504fa20-a190-4fd9-8ae3-da18102818f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:45.045483 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2504fa20-a190-4fd9-8ae3-da18102818f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:45.051893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2504fa20-a190-4fd9-8ae3-da18102818f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:45.052364 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2504fa20-a190-4fd9-8ae3-da18102818f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:45.053121 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2504fa20-a190-4fd9-8ae3-da18102818f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:45.053555 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2504fa20-a190-4fd9-8ae3-da18102818f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:45.115335 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2504fa20-a190-4fd9-8ae3-da18102818f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:45.123278 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2504fa20-a190-4fd9-8ae3-da18102818f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082259 Jul 21 17:59:45.123830 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 621/1233] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:45 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:46.140817 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-996ea7e7-5e87-4f67-982e-c927a0ed1a92 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:46.141434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-996ea7e7-5e87-4f67-982e-c927a0ed1a92 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:46.147936 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-996ea7e7-5e87-4f67-982e-c927a0ed1a92 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:46.148421 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-996ea7e7-5e87-4f67-982e-c927a0ed1a92 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:46.149400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-996ea7e7-5e87-4f67-982e-c927a0ed1a92 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:46.149876 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-996ea7e7-5e87-4f67-982e-c927a0ed1a92 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:46.216800 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-996ea7e7-5e87-4f67-982e-c927a0ed1a92 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:46.224876 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-996ea7e7-5e87-4f67-982e-c927a0ed1a92 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.088378 Jul 21 17:59:46.225449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 613/1234] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:46 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:47.243282 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9a2a3d0b-8112-489b-b3f8-9f03ba0572ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:47.243930 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9a2a3d0b-8112-489b-b3f8-9f03ba0572ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:47.250350 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9a2a3d0b-8112-489b-b3f8-9f03ba0572ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:47.250806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9a2a3d0b-8112-489b-b3f8-9f03ba0572ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:47.251574 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9a2a3d0b-8112-489b-b3f8-9f03ba0572ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:47.252020 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9a2a3d0b-8112-489b-b3f8-9f03ba0572ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:47.314208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9a2a3d0b-8112-489b-b3f8-9f03ba0572ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:47.322903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9a2a3d0b-8112-489b-b3f8-9f03ba0572ff tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084286 Jul 21 17:59:47.323461 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 622/1235] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:48.340128 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6f9dbd34-2b1f-4e85-8d84-4745055cba21 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:48.340725 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6f9dbd34-2b1f-4e85-8d84-4745055cba21 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:48.347752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f9dbd34-2b1f-4e85-8d84-4745055cba21 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:48.348203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f9dbd34-2b1f-4e85-8d84-4745055cba21 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:48.348995 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f9dbd34-2b1f-4e85-8d84-4745055cba21 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:48.349431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f9dbd34-2b1f-4e85-8d84-4745055cba21 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:48.351924 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=84 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:59:48.410932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6f9dbd34-2b1f-4e85-8d84-4745055cba21 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:48.418936 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6f9dbd34-2b1f-4e85-8d84-4745055cba21 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083304 Jul 21 17:59:48.419500 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 614/1236] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:48 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:49.435330 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e8dbcb03-8c97-4515-acb8-9383e107b806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:49.435962 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e8dbcb03-8c97-4515-acb8-9383e107b806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:49.442799 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e8dbcb03-8c97-4515-acb8-9383e107b806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:49.443444 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e8dbcb03-8c97-4515-acb8-9383e107b806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:49.444500 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e8dbcb03-8c97-4515-acb8-9383e107b806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:49.444971 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e8dbcb03-8c97-4515-acb8-9383e107b806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:49.505557 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e8dbcb03-8c97-4515-acb8-9383e107b806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:49.514148 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e8dbcb03-8c97-4515-acb8-9383e107b806 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082663 Jul 21 17:59:49.514712 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 623/1237] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:49 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:50.530125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-90c1bc9d-6f9d-49c3-8c92-5314b679d85a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:50.530765 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-90c1bc9d-6f9d-49c3-8c92-5314b679d85a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:50.537439 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90c1bc9d-6f9d-49c3-8c92-5314b679d85a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:50.537897 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90c1bc9d-6f9d-49c3-8c92-5314b679d85a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:50.538673 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90c1bc9d-6f9d-49c3-8c92-5314b679d85a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:50.539671 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-90c1bc9d-6f9d-49c3-8c92-5314b679d85a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:50.603704 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-90c1bc9d-6f9d-49c3-8c92-5314b679d85a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:50.611680 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-90c1bc9d-6f9d-49c3-8c92-5314b679d85a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085531 Jul 21 17:59:50.612253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 615/1238] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:50 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:51.629169 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d42f95c3-9601-495c-964f-1d8093858f9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:51.629771 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d42f95c3-9601-495c-964f-1d8093858f9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:51.637416 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d42f95c3-9601-495c-964f-1d8093858f9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:51.637868 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d42f95c3-9601-495c-964f-1d8093858f9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:51.638663 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d42f95c3-9601-495c-964f-1d8093858f9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:51.639101 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d42f95c3-9601-495c-964f-1d8093858f9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:51.702336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d42f95c3-9601-495c-964f-1d8093858f9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:51.710360 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d42f95c3-9601-495c-964f-1d8093858f9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085027 Jul 21 17:59:51.710934 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 624/1239] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:52.728051 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d594fb26-d309-4b65-9bc5-7eb1eba7083a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:52.728757 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d594fb26-d309-4b65-9bc5-7eb1eba7083a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:52.735329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d594fb26-d309-4b65-9bc5-7eb1eba7083a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:52.735780 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d594fb26-d309-4b65-9bc5-7eb1eba7083a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:52.736585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d594fb26-d309-4b65-9bc5-7eb1eba7083a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:52.737026 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d594fb26-d309-4b65-9bc5-7eb1eba7083a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:52.797420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d594fb26-d309-4b65-9bc5-7eb1eba7083a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:52.805248 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d594fb26-d309-4b65-9bc5-7eb1eba7083a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081180 Jul 21 17:59:52.805918 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 616/1240] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:52 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:53.822967 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1e38127e-d489-4f09-8fd5-8a749dfdbe2a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:53.823590 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1e38127e-d489-4f09-8fd5-8a749dfdbe2a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:53.830243 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1e38127e-d489-4f09-8fd5-8a749dfdbe2a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:53.830695 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1e38127e-d489-4f09-8fd5-8a749dfdbe2a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:53.831467 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1e38127e-d489-4f09-8fd5-8a749dfdbe2a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:53.831908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1e38127e-d489-4f09-8fd5-8a749dfdbe2a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:53.896143 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1e38127e-d489-4f09-8fd5-8a749dfdbe2a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:53.904660 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1e38127e-d489-4f09-8fd5-8a749dfdbe2a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086053 Jul 21 17:59:53.905230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 625/1241] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:53 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:54.921979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ad36ce2e-128f-48fa-8116-2a8561646cf9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:54.922590 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ad36ce2e-128f-48fa-8116-2a8561646cf9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:54.924918 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=28 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:59:54.930358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad36ce2e-128f-48fa-8116-2a8561646cf9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:54.931439 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad36ce2e-128f-48fa-8116-2a8561646cf9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:54.932360 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad36ce2e-128f-48fa-8116-2a8561646cf9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:54.932800 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad36ce2e-128f-48fa-8116-2a8561646cf9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:54.997508 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ad36ce2e-128f-48fa-8116-2a8561646cf9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:55.005512 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ad36ce2e-128f-48fa-8116-2a8561646cf9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087443 Jul 21 17:59:55.006072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 617/1242] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:54 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:56.022367 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2f1250e7-ab5e-464a-ae55-bbcbb4a52e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:56.022978 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2f1250e7-ab5e-464a-ae55-bbcbb4a52e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:56.025355 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=28 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:59:56.030603 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2f1250e7-ab5e-464a-ae55-bbcbb4a52e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:56.031049 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2f1250e7-ab5e-464a-ae55-bbcbb4a52e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:56.031810 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2f1250e7-ab5e-464a-ae55-bbcbb4a52e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:56.032241 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2f1250e7-ab5e-464a-ae55-bbcbb4a52e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:56.034944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=84 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 17:59:56.096463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2f1250e7-ab5e-464a-ae55-bbcbb4a52e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:56.104325 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2f1250e7-ab5e-464a-ae55-bbcbb4a52e5c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085799 Jul 21 17:59:56.104889 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 626/1243] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:56 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:57.121125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2941d647-6710-41a9-9e21-c70b7684ce43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:57.121739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2941d647-6710-41a9-9e21-c70b7684ce43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:57.128213 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2941d647-6710-41a9-9e21-c70b7684ce43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:57.128692 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2941d647-6710-41a9-9e21-c70b7684ce43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:57.129453 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2941d647-6710-41a9-9e21-c70b7684ce43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:57.129928 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2941d647-6710-41a9-9e21-c70b7684ce43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:57.189853 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2941d647-6710-41a9-9e21-c70b7684ce43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:57.198544 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2941d647-6710-41a9-9e21-c70b7684ce43 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081221 Jul 21 17:59:57.199150 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 618/1244] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:57 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:58.216317 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a3baa4bf-cefe-4b81-a067-224cede928a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:58.216888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a3baa4bf-cefe-4b81-a067-224cede928a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:58.223346 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a3baa4bf-cefe-4b81-a067-224cede928a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:58.223792 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a3baa4bf-cefe-4b81-a067-224cede928a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:58.224583 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a3baa4bf-cefe-4b81-a067-224cede928a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:58.225019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a3baa4bf-cefe-4b81-a067-224cede928a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:58.285258 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a3baa4bf-cefe-4b81-a067-224cede928a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:58.293840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a3baa4bf-cefe-4b81-a067-224cede928a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082287 Jul 21 17:59:58.294396 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 627/1245] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:58 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 17:59:59.311964 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8666b81d-0b0b-4cec-a4d2-8dc3b9018c52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 17:59:59.312608 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8666b81d-0b0b-4cec-a4d2-8dc3b9018c52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 17:59:59.319118 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8666b81d-0b0b-4cec-a4d2-8dc3b9018c52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:59.319566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8666b81d-0b0b-4cec-a4d2-8dc3b9018c52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:59.320346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8666b81d-0b0b-4cec-a4d2-8dc3b9018c52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 17:59:59.320784 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8666b81d-0b0b-4cec-a4d2-8dc3b9018c52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 17:59:59.383604 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8666b81d-0b0b-4cec-a4d2-8dc3b9018c52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 17:59:59.391739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8666b81d-0b0b-4cec-a4d2-8dc3b9018c52 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084070 Jul 21 17:59:59.392325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 619/1246] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 17:59:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:00.408765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9287f309-d3a0-43ce-8e39-9302a60d3dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:00.409386 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9287f309-d3a0-43ce-8e39-9302a60d3dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:00.415800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9287f309-d3a0-43ce-8e39-9302a60d3dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:00.417297 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9287f309-d3a0-43ce-8e39-9302a60d3dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:00.418068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9287f309-d3a0-43ce-8e39-9302a60d3dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:00.418510 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9287f309-d3a0-43ce-8e39-9302a60d3dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:00.482610 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9287f309-d3a0-43ce-8e39-9302a60d3dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:00.490498 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9287f309-d3a0-43ce-8e39-9302a60d3dea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086046 Jul 21 18:00:00.491058 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 628/1247] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:01.507891 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7a7b09eb-74db-41d1-a50c-efc999aeba1b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:01.508554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7a7b09eb-74db-41d1-a50c-efc999aeba1b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:01.515586 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a7b09eb-74db-41d1-a50c-efc999aeba1b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:01.516041 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a7b09eb-74db-41d1-a50c-efc999aeba1b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:01.516840 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a7b09eb-74db-41d1-a50c-efc999aeba1b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:01.517281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a7b09eb-74db-41d1-a50c-efc999aeba1b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:01.580246 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7a7b09eb-74db-41d1-a50c-efc999aeba1b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:01.588853 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7a7b09eb-74db-41d1-a50c-efc999aeba1b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084302 Jul 21 18:00:01.589420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 620/1248] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:01 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:02.605670 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c39d803f-c9ee-458e-ba4d-73c869f7795d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:02.606282 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c39d803f-c9ee-458e-ba4d-73c869f7795d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:02.612346 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c39d803f-c9ee-458e-ba4d-73c869f7795d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:02.612795 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c39d803f-c9ee-458e-ba4d-73c869f7795d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:02.613547 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c39d803f-c9ee-458e-ba4d-73c869f7795d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:02.613978 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c39d803f-c9ee-458e-ba4d-73c869f7795d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:02.675022 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c39d803f-c9ee-458e-ba4d-73c869f7795d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:02.683260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c39d803f-c9ee-458e-ba4d-73c869f7795d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082111 Jul 21 18:00:02.683822 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 629/1249] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:03.700366 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-14b005a1-08dd-4e78-b99c-2192cce5dc38 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:03.700987 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-14b005a1-08dd-4e78-b99c-2192cce5dc38 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:03.707488 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14b005a1-08dd-4e78-b99c-2192cce5dc38 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:03.707952 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14b005a1-08dd-4e78-b99c-2192cce5dc38 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:03.708726 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14b005a1-08dd-4e78-b99c-2192cce5dc38 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:03.709172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14b005a1-08dd-4e78-b99c-2192cce5dc38 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:03.772866 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-14b005a1-08dd-4e78-b99c-2192cce5dc38 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:03.781606 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-14b005a1-08dd-4e78-b99c-2192cce5dc38 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085751 Jul 21 18:00:03.782172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 621/1250] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:03 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:04.798295 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-86301f5e-d3fd-4581-b6b6-81755c053d46 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:04.798930 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-86301f5e-d3fd-4581-b6b6-81755c053d46 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:04.805406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-86301f5e-d3fd-4581-b6b6-81755c053d46 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:04.805874 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-86301f5e-d3fd-4581-b6b6-81755c053d46 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:04.807312 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-86301f5e-d3fd-4581-b6b6-81755c053d46 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:04.807839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-86301f5e-d3fd-4581-b6b6-81755c053d46 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:04.867698 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-86301f5e-d3fd-4581-b6b6-81755c053d46 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:04.876062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-86301f5e-d3fd-4581-b6b6-81755c053d46 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081604 Jul 21 18:00:04.876660 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 630/1251] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:04 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:05.892764 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dfcb88ff-1e65-49d8-be19-c087c4f3f351 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:05.893381 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dfcb88ff-1e65-49d8-be19-c087c4f3f351 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:05.899853 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dfcb88ff-1e65-49d8-be19-c087c4f3f351 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:05.901476 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dfcb88ff-1e65-49d8-be19-c087c4f3f351 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:05.902251 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dfcb88ff-1e65-49d8-be19-c087c4f3f351 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:05.902694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dfcb88ff-1e65-49d8-be19-c087c4f3f351 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:05.965398 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dfcb88ff-1e65-49d8-be19-c087c4f3f351 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:05.973325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dfcb88ff-1e65-49d8-be19-c087c4f3f351 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084388 Jul 21 18:00:05.973889 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 622/1252] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:06.991057 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1847835c-5ec4-49e7-b5cb-92b99a313d2e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:06.991677 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1847835c-5ec4-49e7-b5cb-92b99a313d2e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:06.998542 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1847835c-5ec4-49e7-b5cb-92b99a313d2e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:06.998987 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1847835c-5ec4-49e7-b5cb-92b99a313d2e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:06.999749 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1847835c-5ec4-49e7-b5cb-92b99a313d2e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:07.000209 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1847835c-5ec4-49e7-b5cb-92b99a313d2e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:07.061776 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1847835c-5ec4-49e7-b5cb-92b99a313d2e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:07.069667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1847835c-5ec4-49e7-b5cb-92b99a313d2e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082484 Jul 21 18:00:07.070238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 631/1253] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:06 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:08.087167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ac3d8ae0-5e4d-4e58-bf77-6c87d5db326e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:08.087960 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ac3d8ae0-5e4d-4e58-bf77-6c87d5db326e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:08.094819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac3d8ae0-5e4d-4e58-bf77-6c87d5db326e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:08.095265 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac3d8ae0-5e4d-4e58-bf77-6c87d5db326e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:08.096018 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac3d8ae0-5e4d-4e58-bf77-6c87d5db326e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:08.096489 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac3d8ae0-5e4d-4e58-bf77-6c87d5db326e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:08.159226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ac3d8ae0-5e4d-4e58-bf77-6c87d5db326e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:08.167095 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ac3d8ae0-5e4d-4e58-bf77-6c87d5db326e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084101 Jul 21 18:00:08.167654 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 623/1254] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:09.183196 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7da501df-f3e5-420d-9946-dd9dc379b355 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:09.183807 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7da501df-f3e5-420d-9946-dd9dc379b355 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:09.190557 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7da501df-f3e5-420d-9946-dd9dc379b355 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:09.191005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7da501df-f3e5-420d-9946-dd9dc379b355 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:09.191764 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7da501df-f3e5-420d-9946-dd9dc379b355 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:09.192198 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7da501df-f3e5-420d-9946-dd9dc379b355 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:09.253373 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7da501df-f3e5-420d-9946-dd9dc379b355 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:09.261760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7da501df-f3e5-420d-9946-dd9dc379b355 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082561 Jul 21 18:00:09.262320 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 632/1255] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:10.278976 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2027b98f-6ce0-4091-a3ec-c5df1b86a664 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:10.279603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2027b98f-6ce0-4091-a3ec-c5df1b86a664 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:10.286191 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2027b98f-6ce0-4091-a3ec-c5df1b86a664 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:10.286644 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2027b98f-6ce0-4091-a3ec-c5df1b86a664 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:10.287410 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2027b98f-6ce0-4091-a3ec-c5df1b86a664 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:10.287848 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2027b98f-6ce0-4091-a3ec-c5df1b86a664 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:10.349508 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2027b98f-6ce0-4091-a3ec-c5df1b86a664 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:10.357786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2027b98f-6ce0-4091-a3ec-c5df1b86a664 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083105 Jul 21 18:00:10.358291 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 624/1256] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:10 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:11.375245 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fd0d868b-4a2b-43c9-8884-51809688df79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:11.375853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fd0d868b-4a2b-43c9-8884-51809688df79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:11.382297 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fd0d868b-4a2b-43c9-8884-51809688df79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:11.382746 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fd0d868b-4a2b-43c9-8884-51809688df79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:11.383495 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fd0d868b-4a2b-43c9-8884-51809688df79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:11.383929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fd0d868b-4a2b-43c9-8884-51809688df79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:11.445905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-fd0d868b-4a2b-43c9-8884-51809688df79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:11.453787 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fd0d868b-4a2b-43c9-8884-51809688df79 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082489 Jul 21 18:00:11.454350 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 633/1257] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:11 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:12.470701 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-137feb25-519d-4593-843d-eeac2b5af4ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:12.471319 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-137feb25-519d-4593-843d-eeac2b5af4ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:12.478631 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-137feb25-519d-4593-843d-eeac2b5af4ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:12.479087 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-137feb25-519d-4593-843d-eeac2b5af4ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:12.479885 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-137feb25-519d-4593-843d-eeac2b5af4ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:12.480356 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-137feb25-519d-4593-843d-eeac2b5af4ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:12.543817 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-137feb25-519d-4593-843d-eeac2b5af4ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:12.551758 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-137feb25-519d-4593-843d-eeac2b5af4ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084987 Jul 21 18:00:12.552346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 625/1258] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:12 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:13.568718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dbcd5b62-ec0b-4927-9fa6-3435d4a9499f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:13.569332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dbcd5b62-ec0b-4927-9fa6-3435d4a9499f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:13.576536 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dbcd5b62-ec0b-4927-9fa6-3435d4a9499f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:13.576984 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dbcd5b62-ec0b-4927-9fa6-3435d4a9499f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:13.577742 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dbcd5b62-ec0b-4927-9fa6-3435d4a9499f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:13.578179 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dbcd5b62-ec0b-4927-9fa6-3435d4a9499f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:13.639112 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-dbcd5b62-ec0b-4927-9fa6-3435d4a9499f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:13.646967 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dbcd5b62-ec0b-4927-9fa6-3435d4a9499f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082183 Jul 21 18:00:13.647528 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 634/1259] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:14.664471 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5fc5ed85-6636-4262-ac8a-8c7c08472b48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:14.665091 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5fc5ed85-6636-4262-ac8a-8c7c08472b48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:14.671698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5fc5ed85-6636-4262-ac8a-8c7c08472b48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:14.672165 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5fc5ed85-6636-4262-ac8a-8c7c08472b48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:14.672945 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5fc5ed85-6636-4262-ac8a-8c7c08472b48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:14.673389 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5fc5ed85-6636-4262-ac8a-8c7c08472b48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:14.736588 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5fc5ed85-6636-4262-ac8a-8c7c08472b48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:14.745060 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5fc5ed85-6636-4262-ac8a-8c7c08472b48 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084473 Jul 21 18:00:14.745633 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 626/1260] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:14 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:15.761737 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bc9a00cf-8881-4195-a82a-a8ed9203dca9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:15.762354 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bc9a00cf-8881-4195-a82a-a8ed9203dca9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:15.768860 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc9a00cf-8881-4195-a82a-a8ed9203dca9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:15.769305 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc9a00cf-8881-4195-a82a-a8ed9203dca9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:15.770060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc9a00cf-8881-4195-a82a-a8ed9203dca9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:15.770500 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bc9a00cf-8881-4195-a82a-a8ed9203dca9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:15.831491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-bc9a00cf-8881-4195-a82a-a8ed9203dca9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:15.839532 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bc9a00cf-8881-4195-a82a-a8ed9203dca9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082394 Jul 21 18:00:15.840086 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 635/1261] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:16.857469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dc1902f2-c446-4f24-b0a4-62ba79c31864 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:16.858083 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dc1902f2-c446-4f24-b0a4-62ba79c31864 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:16.865170 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc1902f2-c446-4f24-b0a4-62ba79c31864 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:16.865620 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc1902f2-c446-4f24-b0a4-62ba79c31864 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:16.866387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc1902f2-c446-4f24-b0a4-62ba79c31864 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:16.866828 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc1902f2-c446-4f24-b0a4-62ba79c31864 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:16.931495 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dc1902f2-c446-4f24-b0a4-62ba79c31864 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:16.939813 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dc1902f2-c446-4f24-b0a4-62ba79c31864 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087316 Jul 21 18:00:16.940394 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 627/1262] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:16 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:17.957027 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1a7e90b1-15b2-4065-a2ad-3159dad46d8c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:17.957635 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1a7e90b1-15b2-4065-a2ad-3159dad46d8c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:17.964751 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a7e90b1-15b2-4065-a2ad-3159dad46d8c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:17.965182 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a7e90b1-15b2-4065-a2ad-3159dad46d8c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:17.965936 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a7e90b1-15b2-4065-a2ad-3159dad46d8c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:17.966366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a7e90b1-15b2-4065-a2ad-3159dad46d8c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:18.025834 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1a7e90b1-15b2-4065-a2ad-3159dad46d8c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:18.034335 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1a7e90b1-15b2-4065-a2ad-3159dad46d8c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081123 Jul 21 18:00:18.034895 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 636/1263] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:17 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:19.050963 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-20b57620-52a8-4c80-808e-68b217ac48e5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:19.051483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-20b57620-52a8-4c80-808e-68b217ac48e5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:19.058568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20b57620-52a8-4c80-808e-68b217ac48e5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:19.059012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20b57620-52a8-4c80-808e-68b217ac48e5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:19.059768 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20b57620-52a8-4c80-808e-68b217ac48e5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:19.060201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20b57620-52a8-4c80-808e-68b217ac48e5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:19.063016 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=84 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:00:19.121656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-20b57620-52a8-4c80-808e-68b217ac48e5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:19.129624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-20b57620-52a8-4c80-808e-68b217ac48e5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082600 Jul 21 18:00:19.130182 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 628/1264] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:19 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:20.146858 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e34663b3-d98e-40fa-bc77-bf8baca98123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:20.147460 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e34663b3-d98e-40fa-bc77-bf8baca98123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:20.154464 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e34663b3-d98e-40fa-bc77-bf8baca98123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:20.154907 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e34663b3-d98e-40fa-bc77-bf8baca98123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:20.155703 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e34663b3-d98e-40fa-bc77-bf8baca98123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:20.156139 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e34663b3-d98e-40fa-bc77-bf8baca98123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:20.217968 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e34663b3-d98e-40fa-bc77-bf8baca98123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:20.225784 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e34663b3-d98e-40fa-bc77-bf8baca98123 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082770 Jul 21 18:00:20.226334 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 637/1265] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:20 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:21.243000 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cfea6926-2cf9-48f5-9cdc-14b85b172004 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:21.243632 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cfea6926-2cf9-48f5-9cdc-14b85b172004 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:21.250891 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfea6926-2cf9-48f5-9cdc-14b85b172004 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:21.251348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfea6926-2cf9-48f5-9cdc-14b85b172004 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:21.253446 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfea6926-2cf9-48f5-9cdc-14b85b172004 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:21.253904 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfea6926-2cf9-48f5-9cdc-14b85b172004 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:21.317236 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cfea6926-2cf9-48f5-9cdc-14b85b172004 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:21.325815 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cfea6926-2cf9-48f5-9cdc-14b85b172004 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086786 Jul 21 18:00:21.326383 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 629/1266] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:22.343766 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b72ea0f8-4c17-4741-89e4-e2c62f55b404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:22.344398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b72ea0f8-4c17-4741-89e4-e2c62f55b404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:22.351232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b72ea0f8-4c17-4741-89e4-e2c62f55b404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:22.351679 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b72ea0f8-4c17-4741-89e4-e2c62f55b404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:22.352460 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b72ea0f8-4c17-4741-89e4-e2c62f55b404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:22.352894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b72ea0f8-4c17-4741-89e4-e2c62f55b404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:22.413231 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b72ea0f8-4c17-4741-89e4-e2c62f55b404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:22.421017 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b72ea0f8-4c17-4741-89e4-e2c62f55b404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081444 Jul 21 18:00:22.421576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 638/1267] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:22 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:23.437917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c6672b83-0da4-49c7-b898-130e73608d29 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:23.438554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c6672b83-0da4-49c7-b898-130e73608d29 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:23.445317 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c6672b83-0da4-49c7-b898-130e73608d29 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:23.445772 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c6672b83-0da4-49c7-b898-130e73608d29 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:23.446537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c6672b83-0da4-49c7-b898-130e73608d29 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:23.446976 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c6672b83-0da4-49c7-b898-130e73608d29 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:23.507625 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c6672b83-0da4-49c7-b898-130e73608d29 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:23.515949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c6672b83-0da4-49c7-b898-130e73608d29 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082151 Jul 21 18:00:23.516549 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 630/1268] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:23 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:24.532812 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d0ff25ef-869b-4473-a91c-93aba156b819 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:24.533453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d0ff25ef-869b-4473-a91c-93aba156b819 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:24.539972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d0ff25ef-869b-4473-a91c-93aba156b819 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:24.540450 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d0ff25ef-869b-4473-a91c-93aba156b819 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:24.541411 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d0ff25ef-869b-4473-a91c-93aba156b819 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:24.541849 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d0ff25ef-869b-4473-a91c-93aba156b819 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:24.606758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d0ff25ef-869b-4473-a91c-93aba156b819 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:24.614730 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d0ff25ef-869b-4473-a91c-93aba156b819 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085821 Jul 21 18:00:24.615300 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 639/1269] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:24 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:25.630826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-da9403c9-6c13-459f-aa39-b3964b3c4c14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:25.631446 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-da9403c9-6c13-459f-aa39-b3964b3c4c14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:25.633804 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=28 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:00:25.639921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da9403c9-6c13-459f-aa39-b3964b3c4c14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:25.640400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da9403c9-6c13-459f-aa39-b3964b3c4c14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:25.641167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da9403c9-6c13-459f-aa39-b3964b3c4c14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:25.641622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da9403c9-6c13-459f-aa39-b3964b3c4c14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:25.705059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-da9403c9-6c13-459f-aa39-b3964b3c4c14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:25.713251 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-da9403c9-6c13-459f-aa39-b3964b3c4c14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086081 Jul 21 18:00:25.713847 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 631/1270] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:25 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:26.729278 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-deed852b-5260-4345-89e1-5bb544bf7e14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:26.729907 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-deed852b-5260-4345-89e1-5bb544bf7e14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:26.732626 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=28 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:00:26.737820 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-deed852b-5260-4345-89e1-5bb544bf7e14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:26.738267 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-deed852b-5260-4345-89e1-5bb544bf7e14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:26.739029 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-deed852b-5260-4345-89e1-5bb544bf7e14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:26.739461 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-deed852b-5260-4345-89e1-5bb544bf7e14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:26.742296 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=84 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:00:26.802526 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-deed852b-5260-4345-89e1-5bb544bf7e14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:26.810895 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-deed852b-5260-4345-89e1-5bb544bf7e14 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085260 Jul 21 18:00:26.811728 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 640/1271] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:26 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:27.827949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8d244d91-179a-4a42-8b0c-c1e627137167 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:27.828611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8d244d91-179a-4a42-8b0c-c1e627137167 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:27.835078 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d244d91-179a-4a42-8b0c-c1e627137167 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:27.835529 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d244d91-179a-4a42-8b0c-c1e627137167 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:27.836285 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d244d91-179a-4a42-8b0c-c1e627137167 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:27.836744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d244d91-179a-4a42-8b0c-c1e627137167 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:27.896769 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8d244d91-179a-4a42-8b0c-c1e627137167 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:27.905355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8d244d91-179a-4a42-8b0c-c1e627137167 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081276 Jul 21 18:00:27.905912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 632/1272] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:27 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:28.922616 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3f9bb321-719b-4261-98c6-5ce916aa53cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:28.923238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3f9bb321-719b-4261-98c6-5ce916aa53cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:28.929758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f9bb321-719b-4261-98c6-5ce916aa53cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:28.930213 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f9bb321-719b-4261-98c6-5ce916aa53cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:28.930995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f9bb321-719b-4261-98c6-5ce916aa53cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:28.931439 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f9bb321-719b-4261-98c6-5ce916aa53cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:28.993049 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3f9bb321-719b-4261-98c6-5ce916aa53cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:29.001876 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3f9bb321-719b-4261-98c6-5ce916aa53cd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083129 Jul 21 18:00:29.002452 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 641/1273] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:28 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:30.018648 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bf9c4aa9-54f9-479e-a8ab-e822a6aba7e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:30.019263 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bf9c4aa9-54f9-479e-a8ab-e822a6aba7e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:30.026497 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf9c4aa9-54f9-479e-a8ab-e822a6aba7e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:30.026948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf9c4aa9-54f9-479e-a8ab-e822a6aba7e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:30.027717 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf9c4aa9-54f9-479e-a8ab-e822a6aba7e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:30.028158 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf9c4aa9-54f9-479e-a8ab-e822a6aba7e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:30.093555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bf9c4aa9-54f9-479e-a8ab-e822a6aba7e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:30.101893 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bf9c4aa9-54f9-479e-a8ab-e822a6aba7e7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087062 Jul 21 18:00:30.102461 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 633/1274] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:30 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:31.118673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-56d03a80-fd79-4e1a-831f-def2827b79b0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:31.119405 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-56d03a80-fd79-4e1a-831f-def2827b79b0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:31.125574 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56d03a80-fd79-4e1a-831f-def2827b79b0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:31.126020 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56d03a80-fd79-4e1a-831f-def2827b79b0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:31.126777 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56d03a80-fd79-4e1a-831f-def2827b79b0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:31.127208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-56d03a80-fd79-4e1a-831f-def2827b79b0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:31.187676 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-56d03a80-fd79-4e1a-831f-def2827b79b0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:31.195410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-56d03a80-fd79-4e1a-831f-def2827b79b0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.080784 Jul 21 18:00:31.195969 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 642/1275] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:32.214098 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1b751330-5dc9-4437-912b-1b969e027f31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:32.214663 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1b751330-5dc9-4437-912b-1b969e027f31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:32.220746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b751330-5dc9-4437-912b-1b969e027f31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:32.221203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b751330-5dc9-4437-912b-1b969e027f31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:32.221973 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b751330-5dc9-4437-912b-1b969e027f31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:32.222417 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b751330-5dc9-4437-912b-1b969e027f31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:32.282452 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1b751330-5dc9-4437-912b-1b969e027f31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:32.290329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1b751330-5dc9-4437-912b-1b969e027f31 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081451 Jul 21 18:00:32.290946 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 634/1276] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:32 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:33.307251 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0fff6855-c1c7-4400-85e1-8878d23d9900 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:33.307863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0fff6855-c1c7-4400-85e1-8878d23d9900 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:33.314622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fff6855-c1c7-4400-85e1-8878d23d9900 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:33.315068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fff6855-c1c7-4400-85e1-8878d23d9900 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:33.315820 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fff6855-c1c7-4400-85e1-8878d23d9900 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:33.316251 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fff6855-c1c7-4400-85e1-8878d23d9900 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:33.377129 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0fff6855-c1c7-4400-85e1-8878d23d9900 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:33.384924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0fff6855-c1c7-4400-85e1-8878d23d9900 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081701 Jul 21 18:00:33.385487 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 643/1277] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:33 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:34.401282 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1a21b887-67ec-4427-ab95-5eb48f147e4a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:34.401883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1a21b887-67ec-4427-ab95-5eb48f147e4a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:34.408509 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1a21b887-67ec-4427-ab95-5eb48f147e4a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:34.408964 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1a21b887-67ec-4427-ab95-5eb48f147e4a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:34.409737 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1a21b887-67ec-4427-ab95-5eb48f147e4a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:34.410180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1a21b887-67ec-4427-ab95-5eb48f147e4a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:34.474420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1a21b887-67ec-4427-ab95-5eb48f147e4a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:34.486886 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1a21b887-67ec-4427-ab95-5eb48f147e4a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.090104 Jul 21 18:00:34.487463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 635/1278] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:34 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:35.503999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c2c3045f-8624-4bbe-99a1-7084b1ad2e34 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:35.504626 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c2c3045f-8624-4bbe-99a1-7084b1ad2e34 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:35.512403 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c2c3045f-8624-4bbe-99a1-7084b1ad2e34 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:35.513177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c2c3045f-8624-4bbe-99a1-7084b1ad2e34 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:35.514532 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c2c3045f-8624-4bbe-99a1-7084b1ad2e34 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:35.515254 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c2c3045f-8624-4bbe-99a1-7084b1ad2e34 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:35.577186 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c2c3045f-8624-4bbe-99a1-7084b1ad2e34 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:35.586196 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c2c3045f-8624-4bbe-99a1-7084b1ad2e34 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086032 Jul 21 18:00:35.586765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 644/1279] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:35 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:36.604527 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a25017cf-24ad-46ed-8ba9-af05cd5da504 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:36.605077 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a25017cf-24ad-46ed-8ba9-af05cd5da504 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:36.611535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a25017cf-24ad-46ed-8ba9-af05cd5da504 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:36.611986 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a25017cf-24ad-46ed-8ba9-af05cd5da504 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:36.612780 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a25017cf-24ad-46ed-8ba9-af05cd5da504 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:36.613220 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a25017cf-24ad-46ed-8ba9-af05cd5da504 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:36.675304 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a25017cf-24ad-46ed-8ba9-af05cd5da504 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:36.685724 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a25017cf-24ad-46ed-8ba9-af05cd5da504 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085095 Jul 21 18:00:36.686672 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 636/1280] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:36 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:00:37.703594 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6641ff53-c7c3-44db-9a9d-63a44125b057 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:37.704247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6641ff53-c7c3-44db-9a9d-63a44125b057 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:37.710762 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6641ff53-c7c3-44db-9a9d-63a44125b057 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:37.711213 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6641ff53-c7c3-44db-9a9d-63a44125b057 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:37.711977 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6641ff53-c7c3-44db-9a9d-63a44125b057 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:37.712448 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6641ff53-c7c3-44db-9a9d-63a44125b057 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:37.773082 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6641ff53-c7c3-44db-9a9d-63a44125b057 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:37.781756 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6641ff53-c7c3-44db-9a9d-63a44125b057 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082017 Jul 21 18:00:37.782318 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 645/1281] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:37 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:38.798778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b1249190-ba74-4fda-8584-b31d68109904 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:38.799477 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b1249190-ba74-4fda-8584-b31d68109904 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:38.805999 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b1249190-ba74-4fda-8584-b31d68109904 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:38.806442 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b1249190-ba74-4fda-8584-b31d68109904 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:38.807683 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b1249190-ba74-4fda-8584-b31d68109904 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:38.808124 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b1249190-ba74-4fda-8584-b31d68109904 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:38.871617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b1249190-ba74-4fda-8584-b31d68109904 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:38.879434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b1249190-ba74-4fda-8584-b31d68109904 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084591 Jul 21 18:00:38.879988 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 637/1282] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:38 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:39.896837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-36d4d50f-75e2-4510-91d9-b06e50779a54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:39.897453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-36d4d50f-75e2-4510-91d9-b06e50779a54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:39.905045 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-36d4d50f-75e2-4510-91d9-b06e50779a54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:39.905497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-36d4d50f-75e2-4510-91d9-b06e50779a54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:39.906263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-36d4d50f-75e2-4510-91d9-b06e50779a54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:39.907282 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-36d4d50f-75e2-4510-91d9-b06e50779a54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:39.971987 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-36d4d50f-75e2-4510-91d9-b06e50779a54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:39.979947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-36d4d50f-75e2-4510-91d9-b06e50779a54 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086957 Jul 21 18:00:39.980547 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 646/1283] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:39 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:40.996799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f1de35b6-7d3a-4dbd-9b25-49a8fba007ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:40.997355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f1de35b6-7d3a-4dbd-9b25-49a8fba007ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:41.003937 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f1de35b6-7d3a-4dbd-9b25-49a8fba007ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:41.004419 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f1de35b6-7d3a-4dbd-9b25-49a8fba007ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:41.005186 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f1de35b6-7d3a-4dbd-9b25-49a8fba007ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:41.005628 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f1de35b6-7d3a-4dbd-9b25-49a8fba007ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:41.066327 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f1de35b6-7d3a-4dbd-9b25-49a8fba007ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:41.074342 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f1de35b6-7d3a-4dbd-9b25-49a8fba007ce tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081659 Jul 21 18:00:41.074911 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 638/1284] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:42.092005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8f74b69d-d133-4886-8de6-21c92ef0f654 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:42.092639 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8f74b69d-d133-4886-8de6-21c92ef0f654 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:42.099127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8f74b69d-d133-4886-8de6-21c92ef0f654 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:42.099577 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8f74b69d-d133-4886-8de6-21c92ef0f654 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:42.100366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8f74b69d-d133-4886-8de6-21c92ef0f654 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:42.100808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8f74b69d-d133-4886-8de6-21c92ef0f654 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:42.162539 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8f74b69d-d133-4886-8de6-21c92ef0f654 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:42.171184 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8f74b69d-d133-4886-8de6-21c92ef0f654 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084198 Jul 21 18:00:42.171766 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 647/1285] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:42 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:43.188419 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-626420fc-2dc8-4800-91b3-245b08da8c8b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:43.189058 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-626420fc-2dc8-4800-91b3-245b08da8c8b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:43.195496 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-626420fc-2dc8-4800-91b3-245b08da8c8b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:43.195944 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-626420fc-2dc8-4800-91b3-245b08da8c8b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:43.196731 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-626420fc-2dc8-4800-91b3-245b08da8c8b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:43.197168 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-626420fc-2dc8-4800-91b3-245b08da8c8b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:43.260538 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-626420fc-2dc8-4800-91b3-245b08da8c8b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:43.268449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-626420fc-2dc8-4800-91b3-245b08da8c8b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084183 Jul 21 18:00:43.269016 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 639/1286] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:44.286156 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a4492a28-2f8c-46f5-b16c-d1225b8f3398 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:44.286720 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a4492a28-2f8c-46f5-b16c-d1225b8f3398 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:44.293819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a4492a28-2f8c-46f5-b16c-d1225b8f3398 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:44.294267 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a4492a28-2f8c-46f5-b16c-d1225b8f3398 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:44.295034 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a4492a28-2f8c-46f5-b16c-d1225b8f3398 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:44.295888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a4492a28-2f8c-46f5-b16c-d1225b8f3398 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:44.358380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a4492a28-2f8c-46f5-b16c-d1225b8f3398 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:44.366229 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a4492a28-2f8c-46f5-b16c-d1225b8f3398 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084021 Jul 21 18:00:44.366792 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 648/1287] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:44 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:45.383526 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-63091718-f476-478e-989a-be3296cd4d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:45.384141 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-63091718-f476-478e-989a-be3296cd4d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:45.391348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63091718-f476-478e-989a-be3296cd4d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:45.391804 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63091718-f476-478e-989a-be3296cd4d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:45.392618 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63091718-f476-478e-989a-be3296cd4d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:45.393063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63091718-f476-478e-989a-be3296cd4d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:45.456030 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-63091718-f476-478e-989a-be3296cd4d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:45.464057 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-63091718-f476-478e-989a-be3296cd4d3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084351 Jul 21 18:00:45.464658 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 640/1288] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:45 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:46.481376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-35dd3975-27d8-445c-b23b-774cf77eb7fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:46.481980 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-35dd3975-27d8-445c-b23b-774cf77eb7fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:46.488676 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-35dd3975-27d8-445c-b23b-774cf77eb7fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:46.489129 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-35dd3975-27d8-445c-b23b-774cf77eb7fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:46.489888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-35dd3975-27d8-445c-b23b-774cf77eb7fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:46.490321 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-35dd3975-27d8-445c-b23b-774cf77eb7fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:46.550311 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-35dd3975-27d8-445c-b23b-774cf77eb7fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:46.558247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-35dd3975-27d8-445c-b23b-774cf77eb7fb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081322 Jul 21 18:00:46.558810 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 649/1289] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:46 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:47.575428 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e97d1d71-ab06-48b4-8227-115504c6c2f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:47.576095 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e97d1d71-ab06-48b4-8227-115504c6c2f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:47.582624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e97d1d71-ab06-48b4-8227-115504c6c2f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:47.583127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e97d1d71-ab06-48b4-8227-115504c6c2f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:47.583902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e97d1d71-ab06-48b4-8227-115504c6c2f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:47.584366 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e97d1d71-ab06-48b4-8227-115504c6c2f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:47.648262 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e97d1d71-ab06-48b4-8227-115504c6c2f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:47.656732 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e97d1d71-ab06-48b4-8227-115504c6c2f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085263 Jul 21 18:00:47.657292 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 641/1290] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:48.673124 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-05cd9379-716d-4596-a891-d6aaeade7862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:48.673749 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-05cd9379-716d-4596-a891-d6aaeade7862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:48.680361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-05cd9379-716d-4596-a891-d6aaeade7862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:48.680819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-05cd9379-716d-4596-a891-d6aaeade7862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:48.681594 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-05cd9379-716d-4596-a891-d6aaeade7862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:48.682673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-05cd9379-716d-4596-a891-d6aaeade7862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:48.742627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-05cd9379-716d-4596-a891-d6aaeade7862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:48.751241 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-05cd9379-716d-4596-a891-d6aaeade7862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081947 Jul 21 18:00:48.751803 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 650/1291] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:48 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:49.768449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-562f7359-1e89-43ad-afa5-b0ae3bbb4c20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:49.769193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-562f7359-1e89-43ad-afa5-b0ae3bbb4c20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:49.776490 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-562f7359-1e89-43ad-afa5-b0ae3bbb4c20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:49.777009 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-562f7359-1e89-43ad-afa5-b0ae3bbb4c20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:49.777774 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-562f7359-1e89-43ad-afa5-b0ae3bbb4c20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:49.778208 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-562f7359-1e89-43ad-afa5-b0ae3bbb4c20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:49.780814 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=84 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:00:49.840046 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-562f7359-1e89-43ad-afa5-b0ae3bbb4c20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:49.847869 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-562f7359-1e89-43ad-afa5-b0ae3bbb4c20 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083321 Jul 21 18:00:49.848463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 642/1292] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:49 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:50.864662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-afc12ab4-e81f-4319-8665-685ab85013c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:50.865277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-afc12ab4-e81f-4319-8665-685ab85013c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:50.871773 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-afc12ab4-e81f-4319-8665-685ab85013c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:50.872218 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-afc12ab4-e81f-4319-8665-685ab85013c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:50.873005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-afc12ab4-e81f-4319-8665-685ab85013c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:50.873439 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-afc12ab4-e81f-4319-8665-685ab85013c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:50.934811 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-afc12ab4-e81f-4319-8665-685ab85013c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:50.943049 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-afc12ab4-e81f-4319-8665-685ab85013c4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082269 Jul 21 18:00:50.943616 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 651/1293] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:50 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:00:51.958881 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-33ead171-7e5b-417f-bdea-b844f6e5a36c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:51.959502 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-33ead171-7e5b-417f-bdea-b844f6e5a36c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:51.966256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33ead171-7e5b-417f-bdea-b844f6e5a36c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:51.966705 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33ead171-7e5b-417f-bdea-b844f6e5a36c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:51.967463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33ead171-7e5b-417f-bdea-b844f6e5a36c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:51.967896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33ead171-7e5b-417f-bdea-b844f6e5a36c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:52.031113 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-33ead171-7e5b-417f-bdea-b844f6e5a36c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:52.039493 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-33ead171-7e5b-417f-bdea-b844f6e5a36c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084453 Jul 21 18:00:52.040098 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 643/1294] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:53.057668 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4809b5e7-69c8-4a91-a70a-6bfb47ab2862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:53.058250 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4809b5e7-69c8-4a91-a70a-6bfb47ab2862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:53.065000 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4809b5e7-69c8-4a91-a70a-6bfb47ab2862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:53.065450 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4809b5e7-69c8-4a91-a70a-6bfb47ab2862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:53.066222 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4809b5e7-69c8-4a91-a70a-6bfb47ab2862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:53.066661 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4809b5e7-69c8-4a91-a70a-6bfb47ab2862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:53.132115 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4809b5e7-69c8-4a91-a70a-6bfb47ab2862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:53.140795 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4809b5e7-69c8-4a91-a70a-6bfb47ab2862 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087621 Jul 21 18:00:53.141359 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 652/1295] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:53 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:54.158638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8079043f-1e8d-4789-9e8f-0e9bd43a49ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:54.159262 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8079043f-1e8d-4789-9e8f-0e9bd43a49ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:54.165855 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8079043f-1e8d-4789-9e8f-0e9bd43a49ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:54.166536 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8079043f-1e8d-4789-9e8f-0e9bd43a49ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:54.167214 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8079043f-1e8d-4789-9e8f-0e9bd43a49ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:54.167651 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8079043f-1e8d-4789-9e8f-0e9bd43a49ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:54.228191 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8079043f-1e8d-4789-9e8f-0e9bd43a49ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:54.236146 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8079043f-1e8d-4789-9e8f-0e9bd43a49ae tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082301 Jul 21 18:00:54.236733 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 644/1296] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:54 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:55.253889 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cdd1a1b8-f3c6-4b27-9d89-e075440fb07f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:55.254481 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cdd1a1b8-f3c6-4b27-9d89-e075440fb07f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:55.261190 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cdd1a1b8-f3c6-4b27-9d89-e075440fb07f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:55.261632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cdd1a1b8-f3c6-4b27-9d89-e075440fb07f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:55.262384 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cdd1a1b8-f3c6-4b27-9d89-e075440fb07f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:55.262814 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cdd1a1b8-f3c6-4b27-9d89-e075440fb07f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:55.326574 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-cdd1a1b8-f3c6-4b27-9d89-e075440fb07f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:55.334893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cdd1a1b8-f3c6-4b27-9d89-e075440fb07f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084739 Jul 21 18:00:55.335482 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 653/1297] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:55 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:56.352265 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-571c8e1b-6243-49aa-8743-9f9bacd1092a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:56.352943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-571c8e1b-6243-49aa-8743-9f9bacd1092a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:56.356406 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=28 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:00:56.361781 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-571c8e1b-6243-49aa-8743-9f9bacd1092a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:56.362233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-571c8e1b-6243-49aa-8743-9f9bacd1092a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:56.363001 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-571c8e1b-6243-49aa-8743-9f9bacd1092a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:56.363438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-571c8e1b-6243-49aa-8743-9f9bacd1092a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:56.426753 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-571c8e1b-6243-49aa-8743-9f9bacd1092a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:56.435635 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-571c8e1b-6243-49aa-8743-9f9bacd1092a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.087247 Jul 21 18:00:56.436481 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 645/1298] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:56 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:57.453360 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8093b517-b2fe-4d47-92b7-d126744fa947 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:57.453981 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8093b517-b2fe-4d47-92b7-d126744fa947 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:57.456383 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=28 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:00:57.462170 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8093b517-b2fe-4d47-92b7-d126744fa947 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:57.462625 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8093b517-b2fe-4d47-92b7-d126744fa947 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:57.463382 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8093b517-b2fe-4d47-92b7-d126744fa947 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:57.463813 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8093b517-b2fe-4d47-92b7-d126744fa947 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:57.467936 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=84 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:00:57.525086 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8093b517-b2fe-4d47-92b7-d126744fa947 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:57.532890 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8093b517-b2fe-4d47-92b7-d126744fa947 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083379 Jul 21 18:00:57.533445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 654/1299] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:57 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:58.550089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a356e74-dd29-43af-822b-207b5a7f9aaf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:58.550709 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4a356e74-dd29-43af-822b-207b5a7f9aaf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:58.558316 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a356e74-dd29-43af-822b-207b5a7f9aaf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:58.558778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a356e74-dd29-43af-822b-207b5a7f9aaf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:58.559545 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a356e74-dd29-43af-822b-207b5a7f9aaf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:58.559987 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a356e74-dd29-43af-822b-207b5a7f9aaf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:58.623584 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4a356e74-dd29-43af-822b-207b5a7f9aaf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:58.631447 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4a356e74-dd29-43af-822b-207b5a7f9aaf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085242 Jul 21 18:00:58.632012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 646/1300] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:58 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:00:59.648244 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7ebe0a06-2009-4c17-8eed-c79b57484cd8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:00:59.648903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7ebe0a06-2009-4c17-8eed-c79b57484cd8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:00:59.655748 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7ebe0a06-2009-4c17-8eed-c79b57484cd8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:59.656191 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7ebe0a06-2009-4c17-8eed-c79b57484cd8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:59.656976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7ebe0a06-2009-4c17-8eed-c79b57484cd8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:00:59.657407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7ebe0a06-2009-4c17-8eed-c79b57484cd8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:00:59.718298 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-7ebe0a06-2009-4c17-8eed-c79b57484cd8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:00:59.726081 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7ebe0a06-2009-4c17-8eed-c79b57484cd8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081725 Jul 21 18:00:59.726634 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 655/1301] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:00:59 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:00.743156 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-550d4d81-553d-4826-a745-4133ba9bc3f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:00.744462 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-550d4d81-553d-4826-a745-4133ba9bc3f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:00.751157 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-550d4d81-553d-4826-a745-4133ba9bc3f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:00.751609 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-550d4d81-553d-4826-a745-4133ba9bc3f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:00.752431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-550d4d81-553d-4826-a745-4133ba9bc3f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:00.752874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-550d4d81-553d-4826-a745-4133ba9bc3f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:00.816993 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-550d4d81-553d-4826-a745-4133ba9bc3f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:00.825223 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-550d4d81-553d-4826-a745-4133ba9bc3f7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085976 Jul 21 18:01:00.825786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 647/1302] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:00 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:01:01.841713 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a4a1567a-442e-498d-807a-32a777842a8a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:01.842331 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a4a1567a-442e-498d-807a-32a777842a8a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:01.848529 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a4a1567a-442e-498d-807a-32a777842a8a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:01.848990 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a4a1567a-442e-498d-807a-32a777842a8a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:01.849762 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a4a1567a-442e-498d-807a-32a777842a8a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:01.850209 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a4a1567a-442e-498d-807a-32a777842a8a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:01.911362 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a4a1567a-442e-498d-807a-32a777842a8a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:01.920924 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a4a1567a-442e-498d-807a-32a777842a8a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083441 Jul 21 18:01:01.921501 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 656/1303] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:01 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:01:02.938307 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6dfcb679-abfb-40e8-b0f3-eec74a6a2c91 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:02.938743 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6dfcb679-abfb-40e8-b0f3-eec74a6a2c91 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:02.944906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6dfcb679-abfb-40e8-b0f3-eec74a6a2c91 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:02.945362 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6dfcb679-abfb-40e8-b0f3-eec74a6a2c91 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:02.946121 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6dfcb679-abfb-40e8-b0f3-eec74a6a2c91 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:02.946556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6dfcb679-abfb-40e8-b0f3-eec74a6a2c91 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:03.007469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6dfcb679-abfb-40e8-b0f3-eec74a6a2c91 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:03.016432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6dfcb679-abfb-40e8-b0f3-eec74a6a2c91 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082643 Jul 21 18:01:03.017014 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 648/1304] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:02 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:04.034013 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-49164dc0-224b-45eb-9717-a79eb7a43a90 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:04.034626 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-49164dc0-224b-45eb-9717-a79eb7a43a90 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:04.041692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-49164dc0-224b-45eb-9717-a79eb7a43a90 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:04.042140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-49164dc0-224b-45eb-9717-a79eb7a43a90 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:04.042933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-49164dc0-224b-45eb-9717-a79eb7a43a90 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:04.043369 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-49164dc0-224b-45eb-9717-a79eb7a43a90 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:04.106149 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-49164dc0-224b-45eb-9717-a79eb7a43a90 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:04.114010 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-49164dc0-224b-45eb-9717-a79eb7a43a90 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083919 Jul 21 18:01:04.114598 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 657/1305] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:04 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:05.131446 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6c43beba-b324-4a43-83bd-ae0d2d5f79d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:05.132128 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6c43beba-b324-4a43-83bd-ae0d2d5f79d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:05.139473 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c43beba-b324-4a43-83bd-ae0d2d5f79d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:05.139933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c43beba-b324-4a43-83bd-ae0d2d5f79d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:05.140747 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c43beba-b324-4a43-83bd-ae0d2d5f79d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:05.141192 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c43beba-b324-4a43-83bd-ae0d2d5f79d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:05.204965 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6c43beba-b324-4a43-83bd-ae0d2d5f79d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:05.213015 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6c43beba-b324-4a43-83bd-ae0d2d5f79d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085404 Jul 21 18:01:05.213586 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 649/1306] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:05 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:06.230317 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3829d854-13d0-4f85-adfd-777b8375425d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:06.230952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3829d854-13d0-4f85-adfd-777b8375425d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:06.237607 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3829d854-13d0-4f85-adfd-777b8375425d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:06.238058 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3829d854-13d0-4f85-adfd-777b8375425d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:06.238826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3829d854-13d0-4f85-adfd-777b8375425d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:06.239258 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3829d854-13d0-4f85-adfd-777b8375425d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:06.301717 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3829d854-13d0-4f85-adfd-777b8375425d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:06.309714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3829d854-13d0-4f85-adfd-777b8375425d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083770 Jul 21 18:01:06.310309 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 658/1307] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:06 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:07.326838 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d5e83a1e-3035-4451-b253-80cd9b7a57d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:07.327449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d5e83a1e-3035-4451-b253-80cd9b7a57d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:07.334161 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5e83a1e-3035-4451-b253-80cd9b7a57d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:07.334610 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5e83a1e-3035-4451-b253-80cd9b7a57d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:07.335370 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5e83a1e-3035-4451-b253-80cd9b7a57d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:07.335804 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5e83a1e-3035-4451-b253-80cd9b7a57d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:07.396539 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d5e83a1e-3035-4451-b253-80cd9b7a57d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:07.405038 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d5e83a1e-3035-4451-b253-80cd9b7a57d4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082064 Jul 21 18:01:07.405607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 650/1308] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:07 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:08.422663 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3338f392-b90b-42a5-b7ca-e1ce205b8845 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:08.423302 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3338f392-b90b-42a5-b7ca-e1ce205b8845 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:08.429913 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3338f392-b90b-42a5-b7ca-e1ce205b8845 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:08.430362 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3338f392-b90b-42a5-b7ca-e1ce205b8845 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:08.431804 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3338f392-b90b-42a5-b7ca-e1ce205b8845 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:08.432245 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3338f392-b90b-42a5-b7ca-e1ce205b8845 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:08.492187 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3338f392-b90b-42a5-b7ca-e1ce205b8845 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:08.500775 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3338f392-b90b-42a5-b7ca-e1ce205b8845 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081950 Jul 21 18:01:08.501332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 659/1309] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:08 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:09.517263 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5aa40352-09b4-4475-8582-8075e205688f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:09.517882 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5aa40352-09b4-4475-8582-8075e205688f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:09.524437 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5aa40352-09b4-4475-8582-8075e205688f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:09.524936 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5aa40352-09b4-4475-8582-8075e205688f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:09.525783 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5aa40352-09b4-4475-8582-8075e205688f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:09.526225 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5aa40352-09b4-4475-8582-8075e205688f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:09.591278 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5aa40352-09b4-4475-8582-8075e205688f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:09.599225 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5aa40352-09b4-4475-8582-8075e205688f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085821 Jul 21 18:01:09.599792 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 651/1310] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:09 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:10.615991 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ae23b507-5a11-4069-9342-99da504fe1f6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:10.616646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ae23b507-5a11-4069-9342-99da504fe1f6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:10.623221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae23b507-5a11-4069-9342-99da504fe1f6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:10.623677 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae23b507-5a11-4069-9342-99da504fe1f6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:10.624475 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae23b507-5a11-4069-9342-99da504fe1f6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:10.624915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae23b507-5a11-4069-9342-99da504fe1f6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:10.687380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ae23b507-5a11-4069-9342-99da504fe1f6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:10.695406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ae23b507-5a11-4069-9342-99da504fe1f6 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083297 Jul 21 18:01:10.695967 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 660/1311] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:10 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:11.713240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-da8f5353-a376-4d9f-b12c-7471846f504c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:11.713890 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-da8f5353-a376-4d9f-b12c-7471846f504c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:11.720320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da8f5353-a376-4d9f-b12c-7471846f504c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:11.720772 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da8f5353-a376-4d9f-b12c-7471846f504c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:11.721529 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da8f5353-a376-4d9f-b12c-7471846f504c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:11.721962 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da8f5353-a376-4d9f-b12c-7471846f504c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:11.782824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-da8f5353-a376-4d9f-b12c-7471846f504c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:11.791581 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-da8f5353-a376-4d9f-b12c-7471846f504c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082767 Jul 21 18:01:11.792139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 652/1312] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:11 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:12.809006 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8da0f1d2-f341-437c-b0a1-3bd7c0f865a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:12.809627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8da0f1d2-f341-437c-b0a1-3bd7c0f865a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:12.816477 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8da0f1d2-f341-437c-b0a1-3bd7c0f865a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:12.816937 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8da0f1d2-f341-437c-b0a1-3bd7c0f865a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:12.817705 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8da0f1d2-f341-437c-b0a1-3bd7c0f865a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:12.818148 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8da0f1d2-f341-437c-b0a1-3bd7c0f865a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:12.879943 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8da0f1d2-f341-437c-b0a1-3bd7c0f865a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:12.888122 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8da0f1d2-f341-437c-b0a1-3bd7c0f865a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083767 Jul 21 18:01:12.888907 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 661/1313] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:12 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:13.906057 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4759f9f6-90fb-4d6d-9fce-73243e71ee2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:13.906719 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4759f9f6-90fb-4d6d-9fce-73243e71ee2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:13.913294 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4759f9f6-90fb-4d6d-9fce-73243e71ee2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:13.913753 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4759f9f6-90fb-4d6d-9fce-73243e71ee2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:13.914524 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4759f9f6-90fb-4d6d-9fce-73243e71ee2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:13.914970 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4759f9f6-90fb-4d6d-9fce-73243e71ee2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:13.982470 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4759f9f6-90fb-4d6d-9fce-73243e71ee2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:13.990376 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4759f9f6-90fb-4d6d-9fce-73243e71ee2f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.088204 Jul 21 18:01:13.990942 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 653/1314] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:13 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:15.007662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-55daabe6-3931-4cc4-9791-c51c05f20d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:15.008219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-55daabe6-3931-4cc4-9791-c51c05f20d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:15.015469 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-55daabe6-3931-4cc4-9791-c51c05f20d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:15.015926 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-55daabe6-3931-4cc4-9791-c51c05f20d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:15.016732 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-55daabe6-3931-4cc4-9791-c51c05f20d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:15.017174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-55daabe6-3931-4cc4-9791-c51c05f20d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:15.080623 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-55daabe6-3931-4cc4-9791-c51c05f20d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:15.089209 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-55daabe6-3931-4cc4-9791-c51c05f20d17 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085550 Jul 21 18:01:15.089776 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 662/1315] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:15 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:16.106639 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e10e3897-040b-4360-a20d-18b4326a322e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:16.107166 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e10e3897-040b-4360-a20d-18b4326a322e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:16.113651 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e10e3897-040b-4360-a20d-18b4326a322e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:16.114101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e10e3897-040b-4360-a20d-18b4326a322e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:16.114858 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e10e3897-040b-4360-a20d-18b4326a322e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:16.115290 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e10e3897-040b-4360-a20d-18b4326a322e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:16.177127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e10e3897-040b-4360-a20d-18b4326a322e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:16.187167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e10e3897-040b-4360-a20d-18b4326a322e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085113 Jul 21 18:01:16.187740 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 654/1316] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:16 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:17.204028 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e6e9fa50-7fd5-4283-8018-7d115bce98ba tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:17.204676 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e6e9fa50-7fd5-4283-8018-7d115bce98ba tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:17.211274 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6e9fa50-7fd5-4283-8018-7d115bce98ba tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:17.211723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6e9fa50-7fd5-4283-8018-7d115bce98ba tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:17.212717 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6e9fa50-7fd5-4283-8018-7d115bce98ba tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:17.213171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6e9fa50-7fd5-4283-8018-7d115bce98ba tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:17.273684 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e6e9fa50-7fd5-4283-8018-7d115bce98ba tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:17.281712 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e6e9fa50-7fd5-4283-8018-7d115bce98ba tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081638 Jul 21 18:01:17.282279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 663/1317] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:17 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:18.298600 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-777dae6f-2205-4b71-8742-ecace334ecda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:18.299140 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-777dae6f-2205-4b71-8742-ecace334ecda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:18.305825 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-777dae6f-2205-4b71-8742-ecace334ecda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:18.306261 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-777dae6f-2205-4b71-8742-ecace334ecda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:18.307022 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-777dae6f-2205-4b71-8742-ecace334ecda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:18.307457 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-777dae6f-2205-4b71-8742-ecace334ecda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:18.370625 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-777dae6f-2205-4b71-8742-ecace334ecda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:18.378593 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-777dae6f-2205-4b71-8742-ecace334ecda tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084016 Jul 21 18:01:18.379159 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 655/1318] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:18 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:19.396027 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-25903bf6-8a34-4a71-a90c-4726c28f062c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:19.396664 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-25903bf6-8a34-4a71-a90c-4726c28f062c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:19.403755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25903bf6-8a34-4a71-a90c-4726c28f062c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:19.404202 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25903bf6-8a34-4a71-a90c-4726c28f062c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:19.405003 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25903bf6-8a34-4a71-a90c-4726c28f062c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:19.405442 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25903bf6-8a34-4a71-a90c-4726c28f062c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:19.466382 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-25903bf6-8a34-4a71-a90c-4726c28f062c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:19.474183 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-25903bf6-8a34-4a71-a90c-4726c28f062c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082057 Jul 21 18:01:19.474751 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 664/1319] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:19 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:01:20.491055 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cb89392b-bcb6-4ace-94cf-921d9f525561 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:20.491677 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cb89392b-bcb6-4ace-94cf-921d9f525561 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:20.498508 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb89392b-bcb6-4ace-94cf-921d9f525561 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:20.498959 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb89392b-bcb6-4ace-94cf-921d9f525561 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:20.499726 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb89392b-bcb6-4ace-94cf-921d9f525561 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:20.500167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb89392b-bcb6-4ace-94cf-921d9f525561 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:20.504478 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=84 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:01:20.562445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cb89392b-bcb6-4ace-94cf-921d9f525561 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:20.570383 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cb89392b-bcb6-4ace-94cf-921d9f525561 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083257 Jul 21 18:01:20.575394 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 656/1320] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:20 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:21.588258 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-02654fac-74d6-4279-a8e0-126cdec0d79a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:21.588873 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-02654fac-74d6-4279-a8e0-126cdec0d79a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:21.595312 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-02654fac-74d6-4279-a8e0-126cdec0d79a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:21.595758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-02654fac-74d6-4279-a8e0-126cdec0d79a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:21.596542 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-02654fac-74d6-4279-a8e0-126cdec0d79a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:21.596974 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-02654fac-74d6-4279-a8e0-126cdec0d79a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:21.659422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-02654fac-74d6-4279-a8e0-126cdec0d79a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:21.668104 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-02654fac-74d6-4279-a8e0-126cdec0d79a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084330 Jul 21 18:01:21.668692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 665/1321] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:21 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:22.686331 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-99523358-c4c7-42ff-b598-1452fbc823ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:22.686954 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-99523358-c4c7-42ff-b598-1452fbc823ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:22.693583 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99523358-c4c7-42ff-b598-1452fbc823ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:22.694033 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99523358-c4c7-42ff-b598-1452fbc823ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:22.694799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99523358-c4c7-42ff-b598-1452fbc823ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:22.695233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99523358-c4c7-42ff-b598-1452fbc823ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:22.758622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-99523358-c4c7-42ff-b598-1452fbc823ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:22.766978 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-99523358-c4c7-42ff-b598-1452fbc823ea tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085966 Jul 21 18:01:22.767783 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 657/1322] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:22 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:01:23.784512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-056ba722-62c4-42c7-858f-0fda0ed6c404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:23.785114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-056ba722-62c4-42c7-858f-0fda0ed6c404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:23.791685 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-056ba722-62c4-42c7-858f-0fda0ed6c404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:23.792138 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-056ba722-62c4-42c7-858f-0fda0ed6c404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:23.792933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-056ba722-62c4-42c7-858f-0fda0ed6c404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:23.793374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-056ba722-62c4-42c7-858f-0fda0ed6c404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:23.856143 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-056ba722-62c4-42c7-858f-0fda0ed6c404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:23.863878 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-056ba722-62c4-42c7-858f-0fda0ed6c404 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083418 Jul 21 18:01:23.864465 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 666/1323] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:23 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:24.881130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-91833fcb-2cdf-4728-88c0-9eeae5a50bca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:24.881750 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-91833fcb-2cdf-4728-88c0-9eeae5a50bca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:24.889245 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91833fcb-2cdf-4728-88c0-9eeae5a50bca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:24.889701 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91833fcb-2cdf-4728-88c0-9eeae5a50bca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:24.890472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91833fcb-2cdf-4728-88c0-9eeae5a50bca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:24.890915 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91833fcb-2cdf-4728-88c0-9eeae5a50bca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:24.953518 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-91833fcb-2cdf-4728-88c0-9eeae5a50bca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:24.961619 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-91833fcb-2cdf-4728-88c0-9eeae5a50bca tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084327 Jul 21 18:01:24.962186 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 658/1324] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:24 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:25.979118 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6afbb896-ca5f-46f3-a070-54f66f743b3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:25.979761 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6afbb896-ca5f-46f3-a070-54f66f743b3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:25.986401 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6afbb896-ca5f-46f3-a070-54f66f743b3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:25.986855 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6afbb896-ca5f-46f3-a070-54f66f743b3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:25.987622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6afbb896-ca5f-46f3-a070-54f66f743b3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:25.988057 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6afbb896-ca5f-46f3-a070-54f66f743b3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:26.049669 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6afbb896-ca5f-46f3-a070-54f66f743b3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:26.057853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6afbb896-ca5f-46f3-a070-54f66f743b3e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083307 Jul 21 18:01:26.058409 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 667/1325] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:25 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:27.075644 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a84b7ba-13d5-4696-b027-59e1561d350d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:27.076187 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4a84b7ba-13d5-4696-b027-59e1561d350d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:27.078906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=28 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:01:27.084316 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a84b7ba-13d5-4696-b027-59e1561d350d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:27.084778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a84b7ba-13d5-4696-b027-59e1561d350d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:27.085546 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a84b7ba-13d5-4696-b027-59e1561d350d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:27.085982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a84b7ba-13d5-4696-b027-59e1561d350d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:27.151515 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4a84b7ba-13d5-4696-b027-59e1561d350d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:27.159384 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4a84b7ba-13d5-4696-b027-59e1561d350d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.088416 Jul 21 18:01:27.159944 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 659/1326] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:27 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:28.176046 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b1d23e45-145c-47a3-a004-e8f0487efa83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:28.176703 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b1d23e45-145c-47a3-a004-e8f0487efa83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:28.178984 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=28 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:01:28.184484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b1d23e45-145c-47a3-a004-e8f0487efa83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:28.184945 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b1d23e45-145c-47a3-a004-e8f0487efa83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:28.185978 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b1d23e45-145c-47a3-a004-e8f0487efa83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:28.186473 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b1d23e45-145c-47a3-a004-e8f0487efa83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:28.190542 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=84 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:01:28.247930 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b1d23e45-145c-47a3-a004-e8f0487efa83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:28.256040 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b1d23e45-145c-47a3-a004-e8f0487efa83 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083812 Jul 21 18:01:28.256648 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 668/1327] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:28 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:29.274693 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-068776cb-9e36-47c8-bc85-ea5d168ca3ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:29.276539 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-068776cb-9e36-47c8-bc85-ea5d168ca3ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:29.283204 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-068776cb-9e36-47c8-bc85-ea5d168ca3ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:29.283821 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-068776cb-9e36-47c8-bc85-ea5d168ca3ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:29.284635 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-068776cb-9e36-47c8-bc85-ea5d168ca3ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:29.285074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-068776cb-9e36-47c8-bc85-ea5d168ca3ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:29.354254 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-068776cb-9e36-47c8-bc85-ea5d168ca3ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:29.363352 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-068776cb-9e36-47c8-bc85-ea5d168ca3ee tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.092552 Jul 21 18:01:29.363928 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 660/1328] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:29 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:30.380768 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1d4ff962-5cd4-498a-a861-dc47ffa9ce3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:30.381379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1d4ff962-5cd4-498a-a861-dc47ffa9ce3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:30.389206 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1d4ff962-5cd4-498a-a861-dc47ffa9ce3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:30.389655 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1d4ff962-5cd4-498a-a861-dc47ffa9ce3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:30.390418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1d4ff962-5cd4-498a-a861-dc47ffa9ce3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:30.390859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1d4ff962-5cd4-498a-a861-dc47ffa9ce3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:30.452548 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1d4ff962-5cd4-498a-a861-dc47ffa9ce3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:30.460483 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1d4ff962-5cd4-498a-a861-dc47ffa9ce3f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083507 Jul 21 18:01:30.461046 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 669/1329] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:30 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:31.477827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8c8bc608-158d-41fe-a45c-959f7dd44928 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:31.479050 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8c8bc608-158d-41fe-a45c-959f7dd44928 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:31.485251 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8c8bc608-158d-41fe-a45c-959f7dd44928 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:31.485705 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8c8bc608-158d-41fe-a45c-959f7dd44928 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:31.486471 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8c8bc608-158d-41fe-a45c-959f7dd44928 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:31.486912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8c8bc608-158d-41fe-a45c-959f7dd44928 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:31.549347 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8c8bc608-158d-41fe-a45c-959f7dd44928 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:31.557486 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8c8bc608-158d-41fe-a45c-959f7dd44928 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083573 Jul 21 18:01:31.558053 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 661/1330] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:31 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:32.574209 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-28953edb-e8f3-4f4f-b098-f6a8a090662d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:32.574881 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-28953edb-e8f3-4f4f-b098-f6a8a090662d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:32.580988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-28953edb-e8f3-4f4f-b098-f6a8a090662d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:32.581438 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-28953edb-e8f3-4f4f-b098-f6a8a090662d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:32.582193 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-28953edb-e8f3-4f4f-b098-f6a8a090662d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:32.582628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-28953edb-e8f3-4f4f-b098-f6a8a090662d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:32.642734 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-28953edb-e8f3-4f4f-b098-f6a8a090662d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:32.651216 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-28953edb-e8f3-4f4f-b098-f6a8a090662d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.080903 Jul 21 18:01:32.651774 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 670/1331] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:32 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:33.668006 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e73193eb-93fa-4ab5-a0e5-a3f90ba352ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:33.668776 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e73193eb-93fa-4ab5-a0e5-a3f90ba352ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:33.675349 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e73193eb-93fa-4ab5-a0e5-a3f90ba352ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:33.675830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e73193eb-93fa-4ab5-a0e5-a3f90ba352ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:33.676622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e73193eb-93fa-4ab5-a0e5-a3f90ba352ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:33.677063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e73193eb-93fa-4ab5-a0e5-a3f90ba352ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:33.738283 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e73193eb-93fa-4ab5-a0e5-a3f90ba352ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:33.746954 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e73193eb-93fa-4ab5-a0e5-a3f90ba352ab tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083002 Jul 21 18:01:33.747518 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 662/1332] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:33 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:34.764128 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-31717ef4-bc26-4898-927f-3fe821fb0332 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:34.764773 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-31717ef4-bc26-4898-927f-3fe821fb0332 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:34.771274 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-31717ef4-bc26-4898-927f-3fe821fb0332 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:34.771719 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-31717ef4-bc26-4898-927f-3fe821fb0332 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:34.772523 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-31717ef4-bc26-4898-927f-3fe821fb0332 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:34.772958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-31717ef4-bc26-4898-927f-3fe821fb0332 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:34.833366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-31717ef4-bc26-4898-927f-3fe821fb0332 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:34.841849 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-31717ef4-bc26-4898-927f-3fe821fb0332 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081536 Jul 21 18:01:34.842405 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 671/1333] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:34 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:35.860032 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8d7991ea-1ba0-41be-8051-deda222a2062 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:35.860797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8d7991ea-1ba0-41be-8051-deda222a2062 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:35.867387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d7991ea-1ba0-41be-8051-deda222a2062 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:35.867837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d7991ea-1ba0-41be-8051-deda222a2062 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:35.868743 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d7991ea-1ba0-41be-8051-deda222a2062 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:35.869271 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d7991ea-1ba0-41be-8051-deda222a2062 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:35.932716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8d7991ea-1ba0-41be-8051-deda222a2062 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:35.941227 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8d7991ea-1ba0-41be-8051-deda222a2062 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085334 Jul 21 18:01:35.941788 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 663/1334] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:35 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:36.958039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8e087fa3-fc62-40ef-a791-102642f9e350 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:36.958666 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8e087fa3-fc62-40ef-a791-102642f9e350 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:36.965268 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8e087fa3-fc62-40ef-a791-102642f9e350 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:36.965714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8e087fa3-fc62-40ef-a791-102642f9e350 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:36.966471 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8e087fa3-fc62-40ef-a791-102642f9e350 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:36.966904 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8e087fa3-fc62-40ef-a791-102642f9e350 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:37.028572 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8e087fa3-fc62-40ef-a791-102642f9e350 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:37.036538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8e087fa3-fc62-40ef-a791-102642f9e350 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082302 Jul 21 18:01:37.037107 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 672/1335] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:36 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:38.054614 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-313f7ea5-3d13-48f6-b78a-1a8707f99941 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:38.055230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-313f7ea5-3d13-48f6-b78a-1a8707f99941 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:38.062490 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-313f7ea5-3d13-48f6-b78a-1a8707f99941 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:38.062942 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-313f7ea5-3d13-48f6-b78a-1a8707f99941 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:38.063706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-313f7ea5-3d13-48f6-b78a-1a8707f99941 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:38.064146 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-313f7ea5-3d13-48f6-b78a-1a8707f99941 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:38.124660 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-313f7ea5-3d13-48f6-b78a-1a8707f99941 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:38.132550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-313f7ea5-3d13-48f6-b78a-1a8707f99941 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.081824 Jul 21 18:01:38.133111 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 664/1336] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:38 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:39.151019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a50e02d1-db2f-4f15-bba0-c76edb78722f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:39.151635 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a50e02d1-db2f-4f15-bba0-c76edb78722f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:39.158199 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a50e02d1-db2f-4f15-bba0-c76edb78722f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:39.158654 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a50e02d1-db2f-4f15-bba0-c76edb78722f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:39.159424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a50e02d1-db2f-4f15-bba0-c76edb78722f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:39.159869 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a50e02d1-db2f-4f15-bba0-c76edb78722f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:39.222696 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a50e02d1-db2f-4f15-bba0-c76edb78722f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:39.230774 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a50e02d1-db2f-4f15-bba0-c76edb78722f tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.084532 Jul 21 18:01:39.231346 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 673/1337] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:39 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:40.247745 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4d763d72-4602-4246-bee9-58dbed1acb9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:40.248377 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4d763d72-4602-4246-bee9-58dbed1acb9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:40.255173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d763d72-4602-4246-bee9-58dbed1acb9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:40.255667 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d763d72-4602-4246-bee9-58dbed1acb9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:40.256475 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d763d72-4602-4246-bee9-58dbed1acb9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:40.256921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d763d72-4602-4246-bee9-58dbed1acb9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:40.321224 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4d763d72-4602-4246-bee9-58dbed1acb9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:40.329606 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4d763d72-4602-4246-bee9-58dbed1acb9d tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085821 Jul 21 18:01:40.330181 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 665/1338] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:40 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:41.346828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b23d4c1b-7c0d-4e25-aec9-d6e98706503b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:41.347453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b23d4c1b-7c0d-4e25-aec9-d6e98706503b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:41.355118 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b23d4c1b-7c0d-4e25-aec9-d6e98706503b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:41.355571 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b23d4c1b-7c0d-4e25-aec9-d6e98706503b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:41.356369 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b23d4c1b-7c0d-4e25-aec9-d6e98706503b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:41.356816 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b23d4c1b-7c0d-4e25-aec9-d6e98706503b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:41.418301 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b23d4c1b-7c0d-4e25-aec9-d6e98706503b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:41.426251 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b23d4c1b-7c0d-4e25-aec9-d6e98706503b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083245 Jul 21 18:01:41.426811 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 674/1339] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:41 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:42.443909 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d04d6e29-09aa-48a9-aab2-65b297fc8e19 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:42.444552 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d04d6e29-09aa-48a9-aab2-65b297fc8e19 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:42.451880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d04d6e29-09aa-48a9-aab2-65b297fc8e19 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:42.452399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d04d6e29-09aa-48a9-aab2-65b297fc8e19 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:42.453164 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d04d6e29-09aa-48a9-aab2-65b297fc8e19 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:42.453621 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d04d6e29-09aa-48a9-aab2-65b297fc8e19 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:42.514397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d04d6e29-09aa-48a9-aab2-65b297fc8e19 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:42.522181 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d04d6e29-09aa-48a9-aab2-65b297fc8e19 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082113 Jul 21 18:01:42.522739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 666/1340] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:42 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:43.538911 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-dd15a826-9e96-4c39-b4bf-bb182538fc11 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:43.539529 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-dd15a826-9e96-4c39-b4bf-bb182538fc11 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:43.546561 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dd15a826-9e96-4c39-b4bf-bb182538fc11 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:43.547023 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dd15a826-9e96-4c39-b4bf-bb182538fc11 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:43.547815 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dd15a826-9e96-4c39-b4bf-bb182538fc11 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:43.548256 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-dd15a826-9e96-4c39-b4bf-bb182538fc11 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:43.609916 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-dd15a826-9e96-4c39-b4bf-bb182538fc11 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:43.617758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-dd15a826-9e96-4c39-b4bf-bb182538fc11 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082760 Jul 21 18:01:43.618320 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 675/1341] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:43 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:01:44.635769 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-50a6faa6-4e1b-4507-938e-33118e18cfe1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:44.636420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-50a6faa6-4e1b-4507-938e-33118e18cfe1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:44.642899 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50a6faa6-4e1b-4507-938e-33118e18cfe1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:44.643356 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50a6faa6-4e1b-4507-938e-33118e18cfe1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:44.644122 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50a6faa6-4e1b-4507-938e-33118e18cfe1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:44.644593 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50a6faa6-4e1b-4507-938e-33118e18cfe1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:44.709801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-50a6faa6-4e1b-4507-938e-33118e18cfe1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:44.717841 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-50a6faa6-4e1b-4507-938e-33118e18cfe1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.086784 Jul 21 18:01:44.718407 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 667/1342] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:44 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:45.735415 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1a0db7b0-e68d-4b83-83d3-cbfcc599cffd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:45.736020 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1a0db7b0-e68d-4b83-83d3-cbfcc599cffd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:45.742534 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a0db7b0-e68d-4b83-83d3-cbfcc599cffd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:45.742989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a0db7b0-e68d-4b83-83d3-cbfcc599cffd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:45.744768 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a0db7b0-e68d-4b83-83d3-cbfcc599cffd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:45.745225 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a0db7b0-e68d-4b83-83d3-cbfcc599cffd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:45.805837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1a0db7b0-e68d-4b83-83d3-cbfcc599cffd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:45.814457 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1a0db7b0-e68d-4b83-83d3-cbfcc599cffd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082842 Jul 21 18:01:45.815019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 676/1343] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:45 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:46.831796 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-42f800c1-ce61-40c7-8211-1b47d0aba77a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:46.832431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-42f800c1-ce61-40c7-8211-1b47d0aba77a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:46.839535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42f800c1-ce61-40c7-8211-1b47d0aba77a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:46.839979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42f800c1-ce61-40c7-8211-1b47d0aba77a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:46.840769 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42f800c1-ce61-40c7-8211-1b47d0aba77a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:46.841205 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-42f800c1-ce61-40c7-8211-1b47d0aba77a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:46.902335 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-42f800c1-ce61-40c7-8211-1b47d0aba77a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:46.910178 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-42f800c1-ce61-40c7-8211-1b47d0aba77a tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082372 Jul 21 18:01:46.910745 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 668/1344] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:46 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:47.927183 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6e8f3342-06f6-4d4e-a3fe-a1a25988d8a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:47.927809 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6e8f3342-06f6-4d4e-a3fe-a1a25988d8a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:47.936392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6e8f3342-06f6-4d4e-a3fe-a1a25988d8a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:47.936392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6e8f3342-06f6-4d4e-a3fe-a1a25988d8a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:47.937018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6e8f3342-06f6-4d4e-a3fe-a1a25988d8a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:47.937447 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6e8f3342-06f6-4d4e-a3fe-a1a25988d8a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:47.998879 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6e8f3342-06f6-4d4e-a3fe-a1a25988d8a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:48.006916 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6e8f3342-06f6-4d4e-a3fe-a1a25988d8a5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083632 Jul 21 18:01:48.007478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 677/1345] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:49.023853 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-89d75509-e22b-455d-a38b-b609012ea42b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:49.024482 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-89d75509-e22b-455d-a38b-b609012ea42b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:49.031600 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89d75509-e22b-455d-a38b-b609012ea42b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:49.032057 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89d75509-e22b-455d-a38b-b609012ea42b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:49.032858 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89d75509-e22b-455d-a38b-b609012ea42b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:49.033296 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-89d75509-e22b-455d-a38b-b609012ea42b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:49.096779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-89d75509-e22b-455d-a38b-b609012ea42b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:49.105415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-89d75509-e22b-455d-a38b-b609012ea42b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.085496 Jul 21 18:01:49.105979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 669/1346] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:49 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:50.123205 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1cefc156-1eea-46d2-acf0-a7d49e56f56b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:50.123852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1cefc156-1eea-46d2-acf0-a7d49e56f56b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:50.130304 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1cefc156-1eea-46d2-acf0-a7d49e56f56b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:50.130753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1cefc156-1eea-46d2-acf0-a7d49e56f56b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:50.131523 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1cefc156-1eea-46d2-acf0-a7d49e56f56b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:50.131965 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1cefc156-1eea-46d2-acf0-a7d49e56f56b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:50.193274 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1cefc156-1eea-46d2-acf0-a7d49e56f56b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:50.202265 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1cefc156-1eea-46d2-acf0-a7d49e56f56b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.083748 Jul 21 18:01:50.202835 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 678/1347] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:50 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:51.219321 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1f7ed2d4-a15c-405a-85d3-c238e37cff1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:51.219973 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1f7ed2d4-a15c-405a-85d3-c238e37cff1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:51.226706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f7ed2d4-a15c-405a-85d3-c238e37cff1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:51.227160 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f7ed2d4-a15c-405a-85d3-c238e37cff1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:51.228019 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f7ed2d4-a15c-405a-85d3-c238e37cff1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:51.228598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f7ed2d4-a15c-405a-85d3-c238e37cff1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:51.231122 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=84 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:01:51.289924 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1f7ed2d4-a15c-405a-85d3-c238e37cff1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:51.297962 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1f7ed2d4-a15c-405a-85d3-c238e37cff1c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 200 len: 1369 microversion: 2.1 time: 0.082494 Jul 21 18:01:51.298526 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 670/1348] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:51 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:51.314853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bd197407-f246-4b87-9b29-0e3dfb761a87 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '.version_select at 0x7ffa2c2e4ca0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:51.336982 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bd197407-f246-4b87-9b29-0e3dfb761a87 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940004804" status: 202 len: 0 microversion: 2.1 time: 0.025879 Jul 21 18:01:51.338361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 679/1349] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jul 21 18:01:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940004804 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:01:52.213678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fc99b298-895d-4fcb-af68-d7222284c139 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Action: 'create', calling method: .version_select at 0x7ffa2a3a9700>, body: {"keypair": {"name": "tempest-keypair-28511971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbTJfE7QUr0yGd5PycNa8uz9HLlzOxd/LDacBcJC+AWeerLi0KdZIee/FDTk3QT//OxMM+OBecEfV/V2MXzWNQxTQ+U72D2MjjZpiW8i9EM81GFAxWMznN0QvHdB5EoEQ=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:01:52.228384 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-fc99b298-895d-4fcb-af68-d7222284c139 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Getting quotas for project 5161720524a4488aa42e383597d30144. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:01:52.232413 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-fc99b298-895d-4fcb-af68-d7222284c139 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Getting quotas for user 2ea3ea36439143b8a55f181170efc14a and project 5161720524a4488aa42e383597d30144. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:01:52.259907 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fc99b298-895d-4fcb-af68-d7222284c139 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.050081 Jul 21 18:01:52.260545 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 671/1350] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 18:01:52 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:01:53.746445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1750249925", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cd4920e-3d1b-4840-bbfa-5e190c8ab42a"}], "security_groups": [{"name": "tempest-securitygroup--1460917835"}], "key_name": "tempest-keypair-28511971", "user_data": "}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:01:53.849202 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.network.neutron [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] validate_networks() for [('4cd4920e-3d1b-4840-bbfa-5e190c8ab42a', None, None, None, None, None)] {{(pid=124381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 18:01:54.279912 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Flavor limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 18:01:54.280386 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Image limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 18:01:54.280901 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Flavor pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 18:01:54.281317 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Image pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 18:01:54.281736 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 18:01:54.291054 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:54.291502 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:54.292324 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:54.292764 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:54.313091 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Getting quotas for project 5161720524a4488aa42e383597d30144. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:01:54.318157 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Getting quotas for user 2ea3ea36439143b8a55f181170efc14a and project 5161720524a4488aa42e383597d30144. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:01:54.329622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Going to run 1 instances... {{(pid=124381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 18:01:54.331907 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 18:01:54.386959 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4f657678-ca56-41a5-83c2-dfc5c44c2717 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.646224 Jul 21 18:01:54.387963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 680/1351] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 18:01:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 18:01:54.399063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-33f414de-cebb-4b25-b0da-ad61d4124f8c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:54.401065 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-33f414de-cebb-4b25-b0da-ad61d4124f8c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:54.483777 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-33f414de-cebb-4b25-b0da-ad61d4124f8c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:54.493919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-33f414de-cebb-4b25-b0da-ad61d4124f8c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1236 microversion: 2.1 time: 0.098847 Jul 21 18:01:54.494587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 672/1352] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:54 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1236 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:54.576816 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-db899194-932e-40bd-b37e-c6fef206959c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:54.577318 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-db899194-932e-40bd-b37e-c6fef206959c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:54.586793 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db899194-932e-40bd-b37e-c6fef206959c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:54.588660 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db899194-932e-40bd-b37e-c6fef206959c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:54.589469 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db899194-932e-40bd-b37e-c6fef206959c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:54.589912 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db899194-932e-40bd-b37e-c6fef206959c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:54.622787 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-db899194-932e-40bd-b37e-c6fef206959c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] HTTP exception thrown: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-db899194-932e-40bd-b37e-c6fef206959c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Request method failure captured: Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: DELETE /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c HTTP/1.1 Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Y4MLMBby9pVb6fwZuBjDRRu9HKRFu1ubjEDLV-WnX1WKQKVX_XMZ4Yqw6FkUH0RRqITWcDICF4pmsesAnL59Rfd9lRL-u5FtRZh9LwiE1kZl5RReoX0EElUgVwXfWiOqjbNCaVPpfluVfKkWpY7Bs2i6epWgLEEnsNP5LGqfJDuT0g Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:01:54.624512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:01:54.626332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0917b2a75df4a9ab1d2cbd4fd3f7613", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}] Jul 21 18:01:54.626332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:01:54.626332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 18:01:54.626332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:01:54.626332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 18:01:54.626332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:01:54.626332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:01:54.626332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: fa82bddf9aa0455797d42993fe850ccf Jul 21 18:01:54.626332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 18:01:54.626332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:01:54.626332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 18:01:54.626332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '1b2e5488-2d1e-4068-879f-7ceba9b9f06c'} Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:01:54.627336 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 18:01:54.628972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:01:54.631234 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-db899194-932e-40bd-b37e-c6fef206959c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Returning 404 to user: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:01:54.632076 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-db899194-932e-40bd-b37e-c6fef206959c tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 404 len: 111 microversion: 2.1 time: 0.060912 Jul 21 18:01:54.632653 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 681/1353] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:01:54 2022] DELETE /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:01:54.641326 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d50f8b47-cb7b-4cd7-9c6f-37f5d68eb89f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:54.642072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d50f8b47-cb7b-4cd7-9c6f-37f5d68eb89f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 1b2e5488-2d1e-4068-879f-7ceba9b9f06c] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:54.648184 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d50f8b47-cb7b-4cd7-9c6f-37f5d68eb89f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:54.648777 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d50f8b47-cb7b-4cd7-9c6f-37f5d68eb89f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:54.649553 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d50f8b47-cb7b-4cd7-9c6f-37f5d68eb89f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:54.650377 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d50f8b47-cb7b-4cd7-9c6f-37f5d68eb89f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:54.664655 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-d50f8b47-cb7b-4cd7-9c6f-37f5d68eb89f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] HTTP exception thrown: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d50f8b47-cb7b-4cd7-9c6f-37f5d68eb89f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Request method failure captured: Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c HTTP/1.1 Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y4MLMBby9pVb6fwZuBjDRRu9HKRFu1ubjEDLV-WnX1WKQKVX_XMZ4Yqw6FkUH0RRqITWcDICF4pmsesAnL59Rfd9lRL-u5FtRZh9LwiE1kZl5RReoX0EElUgVwXfWiOqjbNCaVPpfluVfKkWpY7Bs2i6epWgLEEnsNP5LGqfJDuT0g Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:01:54.667555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:01:54.669281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0917b2a75df4a9ab1d2cbd4fd3f7613", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}] Jul 21 18:01:54.669281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:01:54.669281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 18:01:54.669281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:01:54.669281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 18:01:54.669281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:01:54.669281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:01:54.669281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: fa82bddf9aa0455797d42993fe850ccf Jul 21 18:01:54.669281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 18:01:54.669281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:01:54.669281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 18:01:54.669281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '1b2e5488-2d1e-4068-879f-7ceba9b9f06c'} Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:01:54.670250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. Jul 21 18:01:54.671710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:01:54.673546 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d50f8b47-cb7b-4cd7-9c6f-37f5d68eb89f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Returning 404 to user: Instance 1b2e5488-2d1e-4068-879f-7ceba9b9f06c could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:01:54.674210 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d50f8b47-cb7b-4cd7-9c6f-37f5d68eb89f tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c" status: 404 len: 111 microversion: 2.1 time: 0.036681 Jul 21 18:01:54.674778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 673/1354] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:54 2022] GET /compute/v2.1/servers/1b2e5488-2d1e-4068-879f-7ceba9b9f06c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 18:01:55.511347 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3201dd17-fe2d-4372-a668-740ac962b31e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:55.512171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3201dd17-fe2d-4372-a668-740ac962b31e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:55.519040 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3201dd17-fe2d-4372-a668-740ac962b31e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:55.521229 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3201dd17-fe2d-4372-a668-740ac962b31e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:55.522043 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3201dd17-fe2d-4372-a668-740ac962b31e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:55.522493 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3201dd17-fe2d-4372-a668-740ac962b31e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:55.588625 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3201dd17-fe2d-4372-a668-740ac962b31e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:55.604371 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3201dd17-fe2d-4372-a668-740ac962b31e tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1296 microversion: 2.1 time: 0.096935 Jul 21 18:01:55.605214 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 682/1355] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:55 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1296 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:56.622103 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3b550fef-0fe7-4499-8ce1-1eac9869d574 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:56.622729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3b550fef-0fe7-4499-8ce1-1eac9869d574 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:56.629253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b550fef-0fe7-4499-8ce1-1eac9869d574 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:56.629643 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b550fef-0fe7-4499-8ce1-1eac9869d574 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:56.630406 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b550fef-0fe7-4499-8ce1-1eac9869d574 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:56.630839 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b550fef-0fe7-4499-8ce1-1eac9869d574 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:56.770972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3b550fef-0fe7-4499-8ce1-1eac9869d574 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:56.779184 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3b550fef-0fe7-4499-8ce1-1eac9869d574 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1362 microversion: 2.1 time: 0.161385 Jul 21 18:01:56.779762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 674/1356] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:56 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:57.307375 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-18f7d9d5-2955-419d-94cc-7d6c60221190 req-de9d58d9-8766-48cd-b118-3f34dd892f6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f826a69d-58cb-4b71-9282-0678122b31d8", "tag": "06af3328-5150-47b4-b7bb-980ff6100804"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:01:57.315955 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-18f7d9d5-2955-419d-94cc-7d6c60221190 req-de9d58d9-8766-48cd-b118-3f34dd892f6e service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:57.316542 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-18f7d9d5-2955-419d-94cc-7d6c60221190 req-de9d58d9-8766-48cd-b118-3f34dd892f6e service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:57.329536 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-18f7d9d5-2955-419d-94cc-7d6c60221190 req-de9d58d9-8766-48cd-b118-3f34dd892f6e service nova] Creating event network-changed:06af3328-5150-47b4-b7bb-980ff6100804 for instance f826a69d-58cb-4b71-9282-0678122b31d8 on hv-cinder-82549 Jul 21 18:01:57.336708 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-18f7d9d5-2955-419d-94cc-7d6c60221190 req-de9d58d9-8766-48cd-b118-3f34dd892f6e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259150 Jul 21 18:01:57.338543 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 683/1357] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:01:57.796164 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c2a083c1-c2d9-4aec-aaff-4d01ee6ddfe0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:57.796764 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c2a083c1-c2d9-4aec-aaff-4d01ee6ddfe0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:57.799057 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:01:57.804499 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c2a083c1-c2d9-4aec-aaff-4d01ee6ddfe0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:57.804950 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c2a083c1-c2d9-4aec-aaff-4d01ee6ddfe0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:57.805806 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c2a083c1-c2d9-4aec-aaff-4d01ee6ddfe0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:57.806311 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c2a083c1-c2d9-4aec-aaff-4d01ee6ddfe0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:57.956176 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c2a083c1-c2d9-4aec-aaff-4d01ee6ddfe0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:57.963695 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c2a083c1-c2d9-4aec-aaff-4d01ee6ddfe0 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1362 microversion: 2.1 time: 0.171767 Jul 21 18:01:57.964805 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 675/1358] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:57 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:01:58.980996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8645eac2-3ccf-4340-aa9f-9d8e7bfc2035 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:01:58.981692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8645eac2-3ccf-4340-aa9f-9d8e7bfc2035 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:01:58.983644 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:01:58.989385 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8645eac2-3ccf-4340-aa9f-9d8e7bfc2035 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:58.989835 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8645eac2-3ccf-4340-aa9f-9d8e7bfc2035 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:58.990620 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8645eac2-3ccf-4340-aa9f-9d8e7bfc2035 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:01:58.991083 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8645eac2-3ccf-4340-aa9f-9d8e7bfc2035 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:01:58.996908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=78 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:01:59.122390 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8645eac2-3ccf-4340-aa9f-9d8e7bfc2035 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:01:59.130115 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8645eac2-3ccf-4340-aa9f-9d8e7bfc2035 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1362 microversion: 2.1 time: 0.153826 Jul 21 18:01:59.130685 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 684/1359] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:01:58 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:02:00.147191 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ed1cdae1-9ed7-458b-8df9-45e24b54b9ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:02:00.147616 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ed1cdae1-9ed7-458b-8df9-45e24b54b9ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:02:00.154233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed1cdae1-9ed7-458b-8df9-45e24b54b9ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:00.154683 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed1cdae1-9ed7-458b-8df9-45e24b54b9ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:00.155453 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed1cdae1-9ed7-458b-8df9-45e24b54b9ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:00.155893 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed1cdae1-9ed7-458b-8df9-45e24b54b9ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:00.290380 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ed1cdae1-9ed7-458b-8df9-45e24b54b9ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:02:00.300107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ed1cdae1-9ed7-458b-8df9-45e24b54b9ec tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1362 microversion: 2.1 time: 0.156846 Jul 21 18:02:00.300772 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 676/1360] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:02:00 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:02:01.317433 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f8585f73-0ab9-4ee9-8da5-04484edd01bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:02:01.318120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f8585f73-0ab9-4ee9-8da5-04484edd01bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:02:01.325170 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f8585f73-0ab9-4ee9-8da5-04484edd01bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:01.325627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f8585f73-0ab9-4ee9-8da5-04484edd01bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:01.326396 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f8585f73-0ab9-4ee9-8da5-04484edd01bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:01.326840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f8585f73-0ab9-4ee9-8da5-04484edd01bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:01.454957 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f8585f73-0ab9-4ee9-8da5-04484edd01bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:02:01.462505 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f8585f73-0ab9-4ee9-8da5-04484edd01bf tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1362 microversion: 2.1 time: 0.149161 Jul 21 18:02:01.463072 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 685/1361] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:02:01 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:02:02.383543 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-3fee0c0c-4f04-4680-8718-742939bf9153 req-47c6cdcc-7803-4089-a410-0f1037de4776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f826a69d-58cb-4b71-9282-0678122b31d8", "name": "network-vif-plugged", "status": "completed", "tag": "06af3328-5150-47b4-b7bb-980ff6100804"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:02:02.392689 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3fee0c0c-4f04-4680-8718-742939bf9153 req-47c6cdcc-7803-4089-a410-0f1037de4776 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:02.393141 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3fee0c0c-4f04-4680-8718-742939bf9153 req-47c6cdcc-7803-4089-a410-0f1037de4776 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:02.404093 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-3fee0c0c-4f04-4680-8718-742939bf9153 req-47c6cdcc-7803-4089-a410-0f1037de4776 service nova] Creating event network-vif-plugged:06af3328-5150-47b4-b7bb-980ff6100804 for instance f826a69d-58cb-4b71-9282-0678122b31d8 on hv-cinder-82549 Jul 21 18:02:02.407662 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [req-3fee0c0c-4f04-4680-8718-742939bf9153 req-47c6cdcc-7803-4089-a410-0f1037de4776 service nova] [3cabb5b5-9136-4aa2-b570-e48b07ce9389] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 18:02:02.479732 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-62cb7e01-5973-4946-9ad8-1b640587f47b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:02:02.480280 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-62cb7e01-5973-4946-9ad8-1b640587f47b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:02:02.486852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-62cb7e01-5973-4946-9ad8-1b640587f47b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:02.487304 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-62cb7e01-5973-4946-9ad8-1b640587f47b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:02.488070 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-62cb7e01-5973-4946-9ad8-1b640587f47b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:02.488533 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-62cb7e01-5973-4946-9ad8-1b640587f47b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:02.614512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-62cb7e01-5973-4946-9ad8-1b640587f47b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:02:02.623101 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-62cb7e01-5973-4946-9ad8-1b640587f47b tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1362 microversion: 2.1 time: 0.148033 Jul 21 18:02:02.623683 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 686/1362] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:02:02 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:02:03.416158 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [req-3fee0c0c-4f04-4680-8718-742939bf9153 req-47c6cdcc-7803-4089-a410-0f1037de4776 service nova] [3cabb5b5-9136-4aa2-b570-e48b07ce9389] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 42708. Jul 21 18:02:03.419672 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-3fee0c0c-4f04-4680-8718-742939bf9153 req-47c6cdcc-7803-4089-a410-0f1037de4776 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.101535 Jul 21 18:02:03.420289 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 677/1363] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:02:03.639128 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fb2e54e1-49bd-44e4-83ef-3671b4ab4225 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:02:03.639753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fb2e54e1-49bd-44e4-83ef-3671b4ab4225 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:02:03.646332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb2e54e1-49bd-44e4-83ef-3671b4ab4225 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:03.646787 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb2e54e1-49bd-44e4-83ef-3671b4ab4225 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:03.647591 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb2e54e1-49bd-44e4-83ef-3671b4ab4225 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:03.648038 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb2e54e1-49bd-44e4-83ef-3671b4ab4225 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:03.780837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-fb2e54e1-49bd-44e4-83ef-3671b4ab4225 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:02:03.788152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fb2e54e1-49bd-44e4-83ef-3671b4ab4225 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1362 microversion: 2.1 time: 0.152936 Jul 21 18:02:03.788739 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 687/1364] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:02:03 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:02:04.801865 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:02:04.806647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-77062599-d47f-41bd-8c6e-2a9124cd5496 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:02:04.807430 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-77062599-d47f-41bd-8c6e-2a9124cd5496 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:02:04.814238 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77062599-d47f-41bd-8c6e-2a9124cd5496 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:04.814687 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77062599-d47f-41bd-8c6e-2a9124cd5496 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:04.815443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77062599-d47f-41bd-8c6e-2a9124cd5496 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:04.815879 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77062599-d47f-41bd-8c6e-2a9124cd5496 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:04.945521 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-77062599-d47f-41bd-8c6e-2a9124cd5496 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:02:04.954072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-77062599-d47f-41bd-8c6e-2a9124cd5496 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1549 microversion: 2.1 time: 0.153321 Jul 21 18:02:04.954637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 678/1365] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:02:04 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:02:04.970015 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b493320f-733d-40de-a362-0697ede36d74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:02:04.970506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b493320f-733d-40de-a362-0697ede36d74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:02:04.972361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:02:04.973172 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=6 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:02:04.979230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b493320f-733d-40de-a362-0697ede36d74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:04.979689 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b493320f-733d-40de-a362-0697ede36d74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:04.980503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b493320f-733d-40de-a362-0697ede36d74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:04.980951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b493320f-733d-40de-a362-0697ede36d74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:05.063212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b493320f-733d-40de-a362-0697ede36d74 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096978 Jul 21 18:02:05.063820 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 688/1366] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jul 21 18:02:04 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:02:05.981918 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-be0cd816-71be-452a-8c18-71b3bb4fa553 req-ed2d3533-cbdf-445f-90ea-9437434de7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f826a69d-58cb-4b71-9282-0678122b31d8", "tag": "06af3328-5150-47b4-b7bb-980ff6100804"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:02:05.990677 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-be0cd816-71be-452a-8c18-71b3bb4fa553 req-ed2d3533-cbdf-445f-90ea-9437434de7f2 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:05.991190 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-be0cd816-71be-452a-8c18-71b3bb4fa553 req-ed2d3533-cbdf-445f-90ea-9437434de7f2 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:06.002767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-be0cd816-71be-452a-8c18-71b3bb4fa553 req-ed2d3533-cbdf-445f-90ea-9437434de7f2 service nova] Creating event network-changed:06af3328-5150-47b4-b7bb-980ff6100804 for instance f826a69d-58cb-4b71-9282-0678122b31d8 on hv-cinder-82549 Jul 21 18:02:06.008192 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-be0cd816-71be-452a-8c18-71b3bb4fa553 req-ed2d3533-cbdf-445f-90ea-9437434de7f2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031489 Jul 21 18:02:06.009430 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 679/1367] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:02:40.805372 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=9 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:02:40.806227 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=27 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:02:40.810966 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e2051e88-c80c-4482-98a2-88e5dd02de4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:02:40.811459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e2051e88-c80c-4482-98a2-88e5dd02de4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:02:40.818212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2051e88-c80c-4482-98a2-88e5dd02de4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:40.818676 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2051e88-c80c-4482-98a2-88e5dd02de4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:40.819423 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2051e88-c80c-4482-98a2-88e5dd02de4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:02:40.819860 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e2051e88-c80c-4482-98a2-88e5dd02de4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:02:40.845622 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e2051e88-c80c-4482-98a2-88e5dd02de4c tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/ips" status: 200 len: 147 microversion: 2.1 time: 0.041649 Jul 21 18:02:40.846182 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 689/1368] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 18:02:40 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:03:54.728815 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=9 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:03:54.730006 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=35 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:03:54.734522 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c281a134-f706-456d-ba2d-c1c7b414ce96 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:03:54.735109 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c281a134-f706-456d-ba2d-c1c7b414ce96 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:03:54.742174 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c281a134-f706-456d-ba2d-c1c7b414ce96 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:03:54.742627 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c281a134-f706-456d-ba2d-c1c7b414ce96 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:03:54.743385 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c281a134-f706-456d-ba2d-c1c7b414ce96 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:03:54.743874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c281a134-f706-456d-ba2d-c1c7b414ce96 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:03:54.769916 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c281a134-f706-456d-ba2d-c1c7b414ce96 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 18:03:54.847538 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c281a134-f706-456d-ba2d-c1c7b414ce96 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "DELETE /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 204 len: 0 microversion: 2.20 time: 0.119978 Jul 21 18:03:54.848469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 680/1369] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jul 21 18:03:54 2022] DELETE /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 18:03:54.854851 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:03:54.855956 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=4 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:03:54.861069 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-00df4f24-2b26-4336-9f77-b5a1b7e3bbf9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:03:54.861744 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-00df4f24-2b26-4336-9f77-b5a1b7e3bbf9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:03:54.869736 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-00df4f24-2b26-4336-9f77-b5a1b7e3bbf9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:03:54.870197 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-00df4f24-2b26-4336-9f77-b5a1b7e3bbf9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:03:54.870977 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-00df4f24-2b26-4336-9f77-b5a1b7e3bbf9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:03:54.871423 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-00df4f24-2b26-4336-9f77-b5a1b7e3bbf9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:03:55.145794 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-00df4f24-2b26-4336-9f77-b5a1b7e3bbf9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:03:55.153615 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-00df4f24-2b26-4336-9f77-b5a1b7e3bbf9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:03:55.155757 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-00df4f24-2b26-4336-9f77-b5a1b7e3bbf9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:03:55.157008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-00df4f24-2b26-4336-9f77-b5a1b7e3bbf9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1723 microversion: 2.20 time: 0.304195 Jul 21 18:03:55.157579 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 690/1370] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:03:54 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:03:56.175209 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d42ccfc5-ea2c-4af4-8147-e50503cedeea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:03:56.175934 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d42ccfc5-ea2c-4af4-8147-e50503cedeea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:03:56.182418 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d42ccfc5-ea2c-4af4-8147-e50503cedeea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:03:56.183123 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d42ccfc5-ea2c-4af4-8147-e50503cedeea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:03:56.184200 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d42ccfc5-ea2c-4af4-8147-e50503cedeea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:03:56.184686 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d42ccfc5-ea2c-4af4-8147-e50503cedeea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:03:56.221043 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-2069fc6d-1829-4544-8977-e98a971c0c66 req-56d26662-bd95-4ad9-8f6f-c95c2911f40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38995733-7a8d-41fd-8517-ad9b23969807", "name": "network-vif-deleted", "tag": "46810c91-72c1-4c7e-b1e5-9779dda54481"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:03:56.235848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-2069fc6d-1829-4544-8977-e98a971c0c66 req-56d26662-bd95-4ad9-8f6f-c95c2911f40d service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:03:56.236350 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-2069fc6d-1829-4544-8977-e98a971c0c66 req-56d26662-bd95-4ad9-8f6f-c95c2911f40d service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:03:56.249688 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-2069fc6d-1829-4544-8977-e98a971c0c66 req-56d26662-bd95-4ad9-8f6f-c95c2911f40d service nova] Creating event network-vif-deleted:46810c91-72c1-4c7e-b1e5-9779dda54481 for instance 38995733-7a8d-41fd-8517-ad9b23969807 on hv-cinder-82549 Jul 21 18:03:56.255292 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-2069fc6d-1829-4544-8977-e98a971c0c66 req-56d26662-bd95-4ad9-8f6f-c95c2911f40d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038551 Jul 21 18:03:56.256608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 691/1371] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:03:56.332653 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d42ccfc5-ea2c-4af4-8147-e50503cedeea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:03:56.342151 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d42ccfc5-ea2c-4af4-8147-e50503cedeea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:03:56.344620 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d42ccfc5-ea2c-4af4-8147-e50503cedeea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:03:56.346032 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d42ccfc5-ea2c-4af4-8147-e50503cedeea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 200 len: 1656 microversion: 2.20 time: 0.175135 Jul 21 18:03:56.346796 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 681/1372] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:03:56 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 1656 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:03:57.365294 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7bd5dd14-73c7-4afe-928f-a94499544a04 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:03:57.366033 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7bd5dd14-73c7-4afe-928f-a94499544a04 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:03:57.372207 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7bd5dd14-73c7-4afe-928f-a94499544a04 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:03:57.372715 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7bd5dd14-73c7-4afe-928f-a94499544a04 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:03:57.373796 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7bd5dd14-73c7-4afe-928f-a94499544a04 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:03:57.374236 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7bd5dd14-73c7-4afe-928f-a94499544a04 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:03:57.387125 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-7bd5dd14-73c7-4afe-928f-a94499544a04 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] HTTP exception thrown: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7bd5dd14-73c7-4afe-928f-a94499544a04 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Request method failure captured: Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 HTTP/1.1 Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2ZMHOxJgAvMbgMW0iaUKM89p8tyHINXCyN5GwXdmdLf4H_EXsTcwqakpWLNfBrMoQYY5Vq9J0jZNTE29giQQ4PbkTLiH49q0mVJp__vp3nGdUYTLD31aNGu8bRcZ0LFTOeoMvjwdug90r9Jn3l1n4tEXj_Bvy8Nz-Y5X7oMjE-xqz3U Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 444abcf11d564f7692af245f2bd98a84 Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:03:57.389260 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:03:57.391326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/444abcf11d564f7692af245f2bd98a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/444abcf11d564f7692af245f2bd98a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_444abcf11d564f7692af245f2bd98a84", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/444abcf11d564f7692af245f2bd98a84"}]}] Jul 21 18:03:57.391326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:03:57.391326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 444abcf11d564f7692af245f2bd98a84 Jul 21 18:03:57.391326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:03:57.391326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-AttachVolumeShelveTestJSON-951849365-project Jul 21 18:03:57.391326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:03:57.391326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:03:57.391326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: d08a5eaa6d814e388b0af0581a530888 Jul 21 18:03:57.391326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-AttachVolumeShelveTestJSON-951849365-project Jul 21 18:03:57.391326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:03:57.391326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:03:57.391326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '38995733-7a8d-41fd-8517-ad9b23969807'} Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:03:57.392454 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:03:57.394230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:03:57.395763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7bd5dd14-73c7-4afe-928f-a94499544a04 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Returning 404 to user: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:03:57.395763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7bd5dd14-73c7-4afe-928f-a94499544a04 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 404 len: 111 microversion: 2.20 time: 0.030164 Jul 21 18:03:57.395763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 692/1373] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:03:57 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 18:03:57.399364 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-73a80f0c-e9f4-47cd-8032-27249cc43426 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '.version_select at 0x7ffa2a3c04c0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:03:57.416726 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-73a80f0c-e9f4-47cd-8032-27249cc43426 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906429763" status: 204 len: 0 microversion: 2.20 time: 0.021073 Jul 21 18:03:57.417272 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 682/1374] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jul 21 18:03:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906429763 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 21 18:03:58.021443 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0a252a35-e39b-40cf-9356-ef04d53ad9a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Action: 'create', calling method: .version_select at 0x7ffa2c2e45e0>, body: {"keypair": {"name": "tempest-keypair-1869042420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKeWz9IWnfj911Y9ZOEgHuT2QCNnbxhbCDNsTxjeh4kCOf0eIDfsDOLK3NhrtlVMw6+ISmCrmG/GC8ed/eV7Zd2E8IXqGeXuwpX9081JxoaQv1oWlvDkd+EOfdTZptWDQ=="}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:03:58.035189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-0a252a35-e39b-40cf-9356-ef04d53ad9a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Getting quotas for project 444abcf11d564f7692af245f2bd98a84. Resources: {'key_pairs'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:03:58.038978 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-0a252a35-e39b-40cf-9356-ef04d53ad9a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Getting quotas for user d08a5eaa6d814e388b0af0581a530888 and project 444abcf11d564f7692af245f2bd98a84. Resources: {'key_pairs'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:03:58.062499 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0a252a35-e39b-40cf-9356-ef04d53ad9a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044924 Jul 21 18:03:58.063082 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 693/1375] 10.222.0.57 () {62 vars in 1199 bytes} [Thu Jul 21 18:03:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 21 18:03:59.346982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-802378935", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d68f3fcc-4da8-481a-a69e-0d9c32bbf89c"}], "security_groups": [{"name": "tempest-securitygroup--1328933560"}], "key_name": "tempest-keypair-1869042420", "user_data": "}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:03:59.446641 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] validate_networks() for [('d68f3fcc-4da8-481a-a69e-0d9c32bbf89c', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 18:03:59.846505 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 18:03:59.846937 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 18:03:59.847453 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 18:03:59.847896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 18:03:59.848342 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 18:03:59.857068 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:03:59.858522 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:03:59.859330 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:03:59.859777 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:03:59.879230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Getting quotas for project 444abcf11d564f7692af245f2bd98a84. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:03:59.883184 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Getting quotas for user d08a5eaa6d814e388b0af0581a530888 and project 444abcf11d564f7692af245f2bd98a84. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:03:59.894352 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 18:03:59.896596 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 18:03:59.941709 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [df4c8137-8d93-4049-94d8-9c32f123599f] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 18:04:00.949540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [df4c8137-8d93-4049-94d8-9c32f123599f] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 42826. Jul 21 18:04:00.953733 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-290ad441-6865-4df7-895f-9a31f26ed585 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.612219 Jul 21 18:04:00.954379 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 683/1376] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jul 21 18:03:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 18:04:00.964911 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ff2ce989-8d31-4994-a236-971f1fdc1298 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:00.965525 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ff2ce989-8d31-4994-a236-971f1fdc1298 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:01.018497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ff2ce989-8d31-4994-a236-971f1fdc1298 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:01.025841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ff2ce989-8d31-4994-a236-971f1fdc1298 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:01.027352 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ff2ce989-8d31-4994-a236-971f1fdc1298 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:01.028575 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ff2ce989-8d31-4994-a236-971f1fdc1298 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1281 microversion: 2.20 time: 0.067953 Jul 21 18:04:01.029159 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 694/1377] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:00 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:02.047503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0fdfd941-9608-43a0-ba37-33dec73bc341 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:02.048129 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0fdfd941-9608-43a0-ba37-33dec73bc341 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:02.100806 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0fdfd941-9608-43a0-ba37-33dec73bc341 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:02.109792 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0fdfd941-9608-43a0-ba37-33dec73bc341 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:02.111316 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0fdfd941-9608-43a0-ba37-33dec73bc341 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:02.112466 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0fdfd941-9608-43a0-ba37-33dec73bc341 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1281 microversion: 2.20 time: 0.069883 Jul 21 18:04:02.113013 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 684/1378] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:02 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:03.130198 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8e7b26c5-b7e1-4d18-a613-d40b353deb8a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:03.130808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8e7b26c5-b7e1-4d18-a613-d40b353deb8a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:03.190716 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8e7b26c5-b7e1-4d18-a613-d40b353deb8a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:03.197874 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8e7b26c5-b7e1-4d18-a613-d40b353deb8a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:03.199378 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8e7b26c5-b7e1-4d18-a613-d40b353deb8a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:03.200502 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8e7b26c5-b7e1-4d18-a613-d40b353deb8a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1281 microversion: 2.20 time: 0.074251 Jul 21 18:04:03.201219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 695/1379] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:03 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:04.218739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6fbf7735-a616-4943-b649-cbe14b828f36 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:04.219355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6fbf7735-a616-4943-b649-cbe14b828f36 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:04.276099 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6fbf7735-a616-4943-b649-cbe14b828f36 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:04.283742 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6fbf7735-a616-4943-b649-cbe14b828f36 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:04.285290 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6fbf7735-a616-4943-b649-cbe14b828f36 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:04.286393 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6fbf7735-a616-4943-b649-cbe14b828f36 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1281 microversion: 2.20 time: 0.072550 Jul 21 18:04:04.286942 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 685/1380] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:04 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:05.303886 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c6349dc6-17dc-49f4-ae5f-e5b8f937ac24 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:05.304556 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c6349dc6-17dc-49f4-ae5f-e5b8f937ac24 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:05.312077 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c6349dc6-17dc-49f4-ae5f-e5b8f937ac24 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:05.312560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c6349dc6-17dc-49f4-ae5f-e5b8f937ac24 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:05.313327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c6349dc6-17dc-49f4-ae5f-e5b8f937ac24 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:05.313769 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c6349dc6-17dc-49f4-ae5f-e5b8f937ac24 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:05.374543 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c6349dc6-17dc-49f4-ae5f-e5b8f937ac24 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:05.383465 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c6349dc6-17dc-49f4-ae5f-e5b8f937ac24 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:05.386002 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c6349dc6-17dc-49f4-ae5f-e5b8f937ac24 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:05.387791 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c6349dc6-17dc-49f4-ae5f-e5b8f937ac24 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1285 microversion: 2.20 time: 0.087775 Jul 21 18:04:05.388908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 696/1381] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:05 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:06.407688 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-71510ba8-cb8f-465c-af3d-1485257535d1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:06.408313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-71510ba8-cb8f-465c-af3d-1485257535d1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:06.415540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-71510ba8-cb8f-465c-af3d-1485257535d1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:06.415990 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-71510ba8-cb8f-465c-af3d-1485257535d1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:06.416793 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-71510ba8-cb8f-465c-af3d-1485257535d1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:06.417240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-71510ba8-cb8f-465c-af3d-1485257535d1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:06.479695 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-71510ba8-cb8f-465c-af3d-1485257535d1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:06.489154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-71510ba8-cb8f-465c-af3d-1485257535d1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:06.490908 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-71510ba8-cb8f-465c-af3d-1485257535d1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:06.492017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-71510ba8-cb8f-465c-af3d-1485257535d1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1339 microversion: 2.20 time: 0.089176 Jul 21 18:04:06.492601 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 686/1382] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:06 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:07.356041 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-e21ce764-66f1-432f-b439-6324b9b32487 req-6e5ef9b5-9ce1-421a-91c3-c06b2eaef651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f527049-c7ec-49e6-91e1-117b50b70c43", "tag": "185dcd5b-b337-4222-acff-146ba91a9e43"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:04:07.365647 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-e21ce764-66f1-432f-b439-6324b9b32487 req-6e5ef9b5-9ce1-421a-91c3-c06b2eaef651 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:07.366279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-e21ce764-66f1-432f-b439-6324b9b32487 req-6e5ef9b5-9ce1-421a-91c3-c06b2eaef651 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:07.384267 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-e21ce764-66f1-432f-b439-6324b9b32487 req-6e5ef9b5-9ce1-421a-91c3-c06b2eaef651 service nova] Creating event network-changed:185dcd5b-b337-4222-acff-146ba91a9e43 for instance 0f527049-c7ec-49e6-91e1-117b50b70c43 on hv-cinder-82549 Jul 21 18:04:07.397585 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-e21ce764-66f1-432f-b439-6324b9b32487 req-6e5ef9b5-9ce1-421a-91c3-c06b2eaef651 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045690 Jul 21 18:04:07.398119 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 697/1383] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:04:07.511290 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e5eb2db0-8862-465f-b34e-98ea09a4b681 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:07.512065 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e5eb2db0-8862-465f-b34e-98ea09a4b681 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:07.518552 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e5eb2db0-8862-465f-b34e-98ea09a4b681 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:07.519007 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e5eb2db0-8862-465f-b34e-98ea09a4b681 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:07.519788 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e5eb2db0-8862-465f-b34e-98ea09a4b681 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:07.520253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e5eb2db0-8862-465f-b34e-98ea09a4b681 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:07.652640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e5eb2db0-8862-465f-b34e-98ea09a4b681 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:07.660723 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e5eb2db0-8862-465f-b34e-98ea09a4b681 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:07.662234 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e5eb2db0-8862-465f-b34e-98ea09a4b681 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:07.663330 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e5eb2db0-8862-465f-b34e-98ea09a4b681 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1407 microversion: 2.20 time: 0.156179 Jul 21 18:04:07.663886 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 687/1384] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:07 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:08.682906 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-97fc8567-e715-4f10-926c-45e805a493ae tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:08.683602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-97fc8567-e715-4f10-926c-45e805a493ae tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:08.689946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-97fc8567-e715-4f10-926c-45e805a493ae tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:08.690400 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-97fc8567-e715-4f10-926c-45e805a493ae tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:08.691162 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-97fc8567-e715-4f10-926c-45e805a493ae tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:08.691601 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-97fc8567-e715-4f10-926c-45e805a493ae tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:08.819157 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-97fc8567-e715-4f10-926c-45e805a493ae tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:08.827950 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-97fc8567-e715-4f10-926c-45e805a493ae tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:08.829693 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-97fc8567-e715-4f10-926c-45e805a493ae tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:08.830873 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-97fc8567-e715-4f10-926c-45e805a493ae tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1407 microversion: 2.20 time: 0.152940 Jul 21 18:04:08.831507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 698/1385] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:08 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:09.848229 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-688ae160-f080-43b4-9feb-37a0acf6d659 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:09.848874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-688ae160-f080-43b4-9feb-37a0acf6d659 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:09.855283 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-688ae160-f080-43b4-9feb-37a0acf6d659 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:09.855739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-688ae160-f080-43b4-9feb-37a0acf6d659 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:09.856529 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-688ae160-f080-43b4-9feb-37a0acf6d659 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:09.857596 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-688ae160-f080-43b4-9feb-37a0acf6d659 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:09.872077 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:04:09.991664 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-688ae160-f080-43b4-9feb-37a0acf6d659 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:10.000875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-688ae160-f080-43b4-9feb-37a0acf6d659 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:10.002452 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-688ae160-f080-43b4-9feb-37a0acf6d659 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:10.003573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-688ae160-f080-43b4-9feb-37a0acf6d659 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1407 microversion: 2.20 time: 0.159225 Jul 21 18:04:10.004132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 688/1386] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:09 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:11.022036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3a10cc55-3bfd-4725-94b7-1796f8db1f35 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:11.022653 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3a10cc55-3bfd-4725-94b7-1796f8db1f35 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:11.029364 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a10cc55-3bfd-4725-94b7-1796f8db1f35 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:11.029816 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a10cc55-3bfd-4725-94b7-1796f8db1f35 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:11.030605 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a10cc55-3bfd-4725-94b7-1796f8db1f35 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:11.031058 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3a10cc55-3bfd-4725-94b7-1796f8db1f35 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:11.162671 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3a10cc55-3bfd-4725-94b7-1796f8db1f35 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:11.171755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3a10cc55-3bfd-4725-94b7-1796f8db1f35 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:11.173251 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3a10cc55-3bfd-4725-94b7-1796f8db1f35 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:11.174293 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3a10cc55-3bfd-4725-94b7-1796f8db1f35 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1407 microversion: 2.20 time: 0.156379 Jul 21 18:04:11.174852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 699/1387] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:11 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:12.192253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-51ec3ed3-5530-4c6c-85d2-252d6c932efd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:12.192860 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-51ec3ed3-5530-4c6c-85d2-252d6c932efd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:12.199343 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51ec3ed3-5530-4c6c-85d2-252d6c932efd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:12.199798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51ec3ed3-5530-4c6c-85d2-252d6c932efd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:12.200785 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51ec3ed3-5530-4c6c-85d2-252d6c932efd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:12.201315 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51ec3ed3-5530-4c6c-85d2-252d6c932efd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:12.327228 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-51ec3ed3-5530-4c6c-85d2-252d6c932efd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:12.335154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-51ec3ed3-5530-4c6c-85d2-252d6c932efd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:12.336674 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-51ec3ed3-5530-4c6c-85d2-252d6c932efd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:12.337773 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-51ec3ed3-5530-4c6c-85d2-252d6c932efd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1407 microversion: 2.20 time: 0.149507 Jul 21 18:04:12.338417 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 689/1388] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:12 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:13.103478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-bdb44cee-4ee9-403f-b74f-af0b9603d435 req-bb0cb627-8299-4f74-989c-4c04df51a48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f527049-c7ec-49e6-91e1-117b50b70c43", "name": "network-vif-plugged", "status": "completed", "tag": "185dcd5b-b337-4222-acff-146ba91a9e43"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:04:13.113935 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-bdb44cee-4ee9-403f-b74f-af0b9603d435 req-bb0cb627-8299-4f74-989c-4c04df51a48c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:13.114446 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-bdb44cee-4ee9-403f-b74f-af0b9603d435 req-bb0cb627-8299-4f74-989c-4c04df51a48c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:13.127404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-bdb44cee-4ee9-403f-b74f-af0b9603d435 req-bb0cb627-8299-4f74-989c-4c04df51a48c service nova] Creating event network-vif-plugged:185dcd5b-b337-4222-acff-146ba91a9e43 for instance 0f527049-c7ec-49e6-91e1-117b50b70c43 on hv-cinder-82549 Jul 21 18:04:13.132596 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-bdb44cee-4ee9-403f-b74f-af0b9603d435 req-bb0cb627-8299-4f74-989c-4c04df51a48c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032785 Jul 21 18:04:13.133429 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 700/1389] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:04:13.355450 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a35f8d0b-fdc6-4916-bb3e-2d552eaeaf16 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:13.355972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a35f8d0b-fdc6-4916-bb3e-2d552eaeaf16 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:13.362679 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a35f8d0b-fdc6-4916-bb3e-2d552eaeaf16 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:13.363132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a35f8d0b-fdc6-4916-bb3e-2d552eaeaf16 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:13.363900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a35f8d0b-fdc6-4916-bb3e-2d552eaeaf16 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:13.364436 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a35f8d0b-fdc6-4916-bb3e-2d552eaeaf16 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:13.724810 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a35f8d0b-fdc6-4916-bb3e-2d552eaeaf16 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:13.733560 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a35f8d0b-fdc6-4916-bb3e-2d552eaeaf16 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:13.735085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a35f8d0b-fdc6-4916-bb3e-2d552eaeaf16 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:13.736201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a35f8d0b-fdc6-4916-bb3e-2d552eaeaf16 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1407 microversion: 2.20 time: 0.384744 Jul 21 18:04:13.737613 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 690/1390] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:13 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1407 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:14.752365 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=8 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:04:14.757001 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-990bd58d-bcec-457b-819a-a2c6ca21f76f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:14.757696 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-990bd58d-bcec-457b-819a-a2c6ca21f76f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:14.765131 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-990bd58d-bcec-457b-819a-a2c6ca21f76f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:14.765604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-990bd58d-bcec-457b-819a-a2c6ca21f76f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:14.766379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-990bd58d-bcec-457b-819a-a2c6ca21f76f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:14.766817 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-990bd58d-bcec-457b-819a-a2c6ca21f76f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:14.895911 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-990bd58d-bcec-457b-819a-a2c6ca21f76f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:14.903747 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-990bd58d-bcec-457b-819a-a2c6ca21f76f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:14.905267 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-990bd58d-bcec-457b-819a-a2c6ca21f76f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:04:14.906413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-990bd58d-bcec-457b-819a-a2c6ca21f76f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1598 microversion: 2.20 time: 0.155065 Jul 21 18:04:14.906968 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 701/1391] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:04:14 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:04:14.923425 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4d96886c-e571-48b0-b6b2-14b28c62ceb4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:14.924028 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4d96886c-e571-48b0-b6b2-14b28c62ceb4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:14.925797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=10 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:04:14.931665 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d96886c-e571-48b0-b6b2-14b28c62ceb4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:14.932115 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d96886c-e571-48b0-b6b2-14b28c62ceb4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:14.933156 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d96886c-e571-48b0-b6b2-14b28c62ceb4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:14.933592 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d96886c-e571-48b0-b6b2-14b28c62ceb4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:15.013875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4d96886c-e571-48b0-b6b2-14b28c62ceb4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093529 Jul 21 18:04:15.014467 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 691/1392] 10.222.0.57 () {60 vars in 1315 bytes} [Thu Jul 21 18:04:14 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 18:04:15.928323 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-b24bab19-4037-45f5-8162-a4a2814da166 req-650e5f34-ed1a-456b-878c-40cb075a4030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f527049-c7ec-49e6-91e1-117b50b70c43", "tag": "185dcd5b-b337-4222-acff-146ba91a9e43"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:04:15.937526 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-b24bab19-4037-45f5-8162-a4a2814da166 req-650e5f34-ed1a-456b-878c-40cb075a4030 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:15.938049 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-b24bab19-4037-45f5-8162-a4a2814da166 req-650e5f34-ed1a-456b-878c-40cb075a4030 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:15.949140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-b24bab19-4037-45f5-8162-a4a2814da166 req-650e5f34-ed1a-456b-878c-40cb075a4030 service nova] Creating event network-changed:185dcd5b-b337-4222-acff-146ba91a9e43 for instance 0f527049-c7ec-49e6-91e1-117b50b70c43 on hv-cinder-82549 Jul 21 18:04:15.955208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-b24bab19-4037-45f5-8162-a4a2814da166 req-650e5f34-ed1a-456b-878c-40cb075a4030 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030582 Jul 21 18:04:15.955833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 702/1393] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:04:18.090561 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 21 18:04:18.090561 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 18:04:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:04:50.980412 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:04:50.981222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:04:50.985151 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7f180d88-7e38-4f1d-a429-38fa0eaef573 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:04:50.985649 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7f180d88-7e38-4f1d-a429-38fa0eaef573 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:04:50.992920 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f180d88-7e38-4f1d-a429-38fa0eaef573 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:50.993348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f180d88-7e38-4f1d-a429-38fa0eaef573 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:50.994114 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f180d88-7e38-4f1d-a429-38fa0eaef573 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:04:50.994558 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f180d88-7e38-4f1d-a429-38fa0eaef573 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:04:51.019689 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7f180d88-7e38-4f1d-a429-38fa0eaef573 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/ips" status: 200 len: 151 microversion: 2.20 time: 0.040602 Jul 21 18:04:51.020257 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 692/1394] 10.222.0.57 () {60 vars in 1288 bytes} [Thu Jul 21 18:04:50 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 18:06:35.865213 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 18:06:35.865882 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 18:06:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:06:43.925568 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 18:06:43.926742 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 18:06:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:06:48.055021 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jul 21 18:07:01.587459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 18:07:01.588048 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 18:07:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:07:04.181985 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b71c6463-130e-4aa5-9606-3f6bbe5d89f7] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 18:07:04.182769 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:04.183412 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=40 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:04.187997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1254046949", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "networks": [{"uuid": "6ffaf82a-6d6d-424d-bd1e-ff6283406a7d"}]}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:04.240730 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.network.neutron [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] validate_networks() for [('6ffaf82a-6d6d-424d-bd1e-ff6283406a7d', None, None, None, None, None)] {{(pid=124381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 18:07:04.628999 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Flavor limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 18:07:04.629426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Image limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 18:07:04.629904 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Flavor pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 18:07:04.630315 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Image pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 18:07:04.630781 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 18:07:04.640275 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:04.640751 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:04.641542 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:04.641980 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:04.658482 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Getting quotas for project e47e6891d6044e2caf067cad4309c57f. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:07:04.663208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Getting quotas for user ac4cfa3ccdab43c3adafcef62e62365f and project e47e6891d6044e2caf067cad4309c57f. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:07:04.673825 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Going to run 1 instances... {{(pid=124381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 18:07:04.676279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 18:07:04.723917 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-85c57a3a-1c45-4fda-95da-a0aafb5511cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543810 Jul 21 18:07:04.724590 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 703/1395] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 18:07:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 18:07:04.732709 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [-] [769f48e3-05be-4b42-ac4d-f350afc85548] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 21 18:07:04.733229 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:04.733888 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:04.738052 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-81a80b57-bd42-4109-9b62-ae9933842a84 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:04.738757 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-81a80b57-bd42-4109-9b62-ae9933842a84 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:04.795414 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-81a80b57-bd42-4109-9b62-ae9933842a84 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:04.802127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-81a80b57-bd42-4109-9b62-ae9933842a84 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1219 microversion: 2.1 time: 0.071478 Jul 21 18:07:04.802694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 693/1396] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:04 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:05.163244 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-141b1e34-e841-4629-86a3-38f2ae86e849 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a86800f4-ab09-416d-b145-cf66ad17bf39"}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:05.164695 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-141b1e34-e841-4629-86a3-38f2ae86e849 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:05.172359 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-141b1e34-e841-4629-86a3-38f2ae86e849 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:05.173024 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-141b1e34-e841-4629-86a3-38f2ae86e849 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:05.173802 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-141b1e34-e841-4629-86a3-38f2ae86e849 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:05.174550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-141b1e34-e841-4629-86a3-38f2ae86e849 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:05.200543 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] [b71c6463-130e-4aa5-9606-3f6bbe5d89f7] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 43530. Jul 21 18:07:05.461720 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-141b1e34-e841-4629-86a3-38f2ae86e849 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "POST /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303915 Jul 21 18:07:05.462693 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 704/1397] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 18:07:05 2022] POST /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:07:05.822676 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-15120040-151f-47ae-88fe-ba47767edb8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:05.824463 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-15120040-151f-47ae-88fe-ba47767edb8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:05.837459 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-15120040-151f-47ae-88fe-ba47767edb8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:05.838192 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-15120040-151f-47ae-88fe-ba47767edb8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:05.839070 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-15120040-151f-47ae-88fe-ba47767edb8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:05.839573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-15120040-151f-47ae-88fe-ba47767edb8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:05.865249 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] [769f48e3-05be-4b42-ac4d-f350afc85548] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 43546. Jul 21 18:07:05.914563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-15120040-151f-47ae-88fe-ba47767edb8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:05.927331 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-15120040-151f-47ae-88fe-ba47767edb8c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1279 microversion: 2.1 time: 0.110473 Jul 21 18:07:05.937914 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 694/1398] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:05 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1279 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:06.836423 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-33ba4ddb-ad0a-4e4d-9994-8fe60295f1f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:06.837933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-33ba4ddb-ad0a-4e4d-9994-8fe60295f1f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:06.849271 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-33ba4ddb-ad0a-4e4d-9994-8fe60295f1f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:06.849729 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-33ba4ddb-ad0a-4e4d-9994-8fe60295f1f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:06.850708 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-33ba4ddb-ad0a-4e4d-9994-8fe60295f1f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:06.851455 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-33ba4ddb-ad0a-4e4d-9994-8fe60295f1f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:06.876132 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.objects.instance [None req-33ba4ddb-ad0a-4e4d-9994-8fe60295f1f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lazy-loading 'flavor' on Instance uuid 0f527049-c7ec-49e6-91e1-117b50b70c43 {{(pid=124381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 18:07:06.946400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a1850ad4-5482-41bf-a266-cfabcf1c32c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:06.947584 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a1850ad4-5482-41bf-a266-cfabcf1c32c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:06.956378 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a1850ad4-5482-41bf-a266-cfabcf1c32c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:06.957639 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a1850ad4-5482-41bf-a266-cfabcf1c32c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:06.958728 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a1850ad4-5482-41bf-a266-cfabcf1c32c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:06.959329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a1850ad4-5482-41bf-a266-cfabcf1c32c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:07.067494 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 18:07:07.067494 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 18:07:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b (ip 10.222.0.57) !!! Jul 21 18:07:07.107688 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a1850ad4-5482-41bf-a266-cfabcf1c32c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:07.115713 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a1850ad4-5482-41bf-a266-cfabcf1c32c6 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1319 microversion: 2.1 time: 0.174478 Jul 21 18:07:07.120339 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 695/1399] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:06 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:07.201831 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-33ba4ddb-ad0a-4e4d-9994-8fe60295f1f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "POST /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/action" status: 202 len: 0 microversion: 2.20 time: 0.370959 Jul 21 18:07:07.202568 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 705/1400] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jul 21 18:07:06 2022] POST /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 18:07:07.212218 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fcd203a1-b446-4fb1-99ed-42dfade527f9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:07.212950 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fcd203a1-b446-4fb1-99ed-42dfade527f9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:07.219075 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fcd203a1-b446-4fb1-99ed-42dfade527f9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:07.219533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fcd203a1-b446-4fb1-99ed-42dfade527f9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:07.220358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fcd203a1-b446-4fb1-99ed-42dfade527f9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:07.220798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fcd203a1-b446-4fb1-99ed-42dfade527f9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:07.365479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fcd203a1-b446-4fb1-99ed-42dfade527f9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:07.373527 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fcd203a1-b446-4fb1-99ed-42dfade527f9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:07.375119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fcd203a1-b446-4fb1-99ed-42dfade527f9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:07.376389 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fcd203a1-b446-4fb1-99ed-42dfade527f9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1723 microversion: 2.20 time: 0.169431 Jul 21 18:07:07.377039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 696/1401] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:07 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 18:07:07.880081 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-2ae7f55e-a802-4eb5-a28a-bae2135870b3 req-06219ae5-866c-4134-94f6-cf375f7b38b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab08501-7006-4b72-a3fa-caaec63f9b9b", "tag": "dd3b6974-16c9-4b8e-991d-b6f68658f030"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:07.888240 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-2ae7f55e-a802-4eb5-a28a-bae2135870b3 req-06219ae5-866c-4134-94f6-cf375f7b38b3 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:07.888723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-2ae7f55e-a802-4eb5-a28a-bae2135870b3 req-06219ae5-866c-4134-94f6-cf375f7b38b3 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:07.900256 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-2ae7f55e-a802-4eb5-a28a-bae2135870b3 req-06219ae5-866c-4134-94f6-cf375f7b38b3 service nova] Creating event network-changed:dd3b6974-16c9-4b8e-991d-b6f68658f030 for instance eab08501-7006-4b72-a3fa-caaec63f9b9b on hv-cinder-82549 Jul 21 18:07:07.904898 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-2ae7f55e-a802-4eb5-a28a-bae2135870b3 req-06219ae5-866c-4134-94f6-cf375f7b38b3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101276 Jul 21 18:07:07.905478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 706/1402] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:07:08.134752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-48ccf22f-d357-4d4d-9968-5f5b8f7f8ab9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:08.135280 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-48ccf22f-d357-4d4d-9968-5f5b8f7f8ab9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:08.141815 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48ccf22f-d357-4d4d-9968-5f5b8f7f8ab9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:08.142267 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48ccf22f-d357-4d4d-9968-5f5b8f7f8ab9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:08.143039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48ccf22f-d357-4d4d-9968-5f5b8f7f8ab9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:08.143476 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48ccf22f-d357-4d4d-9968-5f5b8f7f8ab9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:08.273862 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-48ccf22f-d357-4d4d-9968-5f5b8f7f8ab9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:08.281352 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-48ccf22f-d357-4d4d-9968-5f5b8f7f8ab9 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1319 microversion: 2.1 time: 0.150945 Jul 21 18:07:08.281921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 697/1403] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:08 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:08.395938 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e6fb11ef-e88b-4bfb-a942-029fedb8b29d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:08.396641 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e6fb11ef-e88b-4bfb-a942-029fedb8b29d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:08.403021 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6fb11ef-e88b-4bfb-a942-029fedb8b29d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:08.403480 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6fb11ef-e88b-4bfb-a942-029fedb8b29d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:08.404256 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6fb11ef-e88b-4bfb-a942-029fedb8b29d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:08.404727 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e6fb11ef-e88b-4bfb-a942-029fedb8b29d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:08.535194 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e6fb11ef-e88b-4bfb-a942-029fedb8b29d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:08.543293 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e6fb11ef-e88b-4bfb-a942-029fedb8b29d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:08.544852 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e6fb11ef-e88b-4bfb-a942-029fedb8b29d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:08.546016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e6fb11ef-e88b-4bfb-a942-029fedb8b29d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1723 microversion: 2.20 time: 0.154910 Jul 21 18:07:08.546568 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 707/1404] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:08 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:09.298404 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-373eaf78-3e2d-4740-b7cc-c8f35b19137d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:09.299022 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-373eaf78-3e2d-4740-b7cc-c8f35b19137d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:09.305842 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-373eaf78-3e2d-4740-b7cc-c8f35b19137d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:09.306328 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-373eaf78-3e2d-4740-b7cc-c8f35b19137d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:09.307122 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-373eaf78-3e2d-4740-b7cc-c8f35b19137d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:09.307541 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-373eaf78-3e2d-4740-b7cc-c8f35b19137d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:09.443605 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-373eaf78-3e2d-4740-b7cc-c8f35b19137d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:09.451124 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-373eaf78-3e2d-4740-b7cc-c8f35b19137d tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1319 microversion: 2.1 time: 0.156751 Jul 21 18:07:09.451695 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 698/1405] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:09 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:09.610388 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ab89e0e2-314d-4f57-8023-1449aed5727a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:09.611004 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ab89e0e2-314d-4f57-8023-1449aed5727a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:09.618281 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ab89e0e2-314d-4f57-8023-1449aed5727a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:09.618731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ab89e0e2-314d-4f57-8023-1449aed5727a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:09.619504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ab89e0e2-314d-4f57-8023-1449aed5727a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:09.619941 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ab89e0e2-314d-4f57-8023-1449aed5727a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:09.756410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ab89e0e2-314d-4f57-8023-1449aed5727a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:09.764230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ab89e0e2-314d-4f57-8023-1449aed5727a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:09.765766 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ab89e0e2-314d-4f57-8023-1449aed5727a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:09.766915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ab89e0e2-314d-4f57-8023-1449aed5727a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1723 microversion: 2.20 time: 0.160430 Jul 21 18:07:09.767467 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 708/1406] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:09 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:10.468479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-72e80de3-f2ee-4657-84f1-1884a939d4b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:10.469128 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-72e80de3-f2ee-4657-84f1-1884a939d4b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:10.476367 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-72e80de3-f2ee-4657-84f1-1884a939d4b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:10.476823 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-72e80de3-f2ee-4657-84f1-1884a939d4b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:10.477591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-72e80de3-f2ee-4657-84f1-1884a939d4b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:10.478030 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-72e80de3-f2ee-4657-84f1-1884a939d4b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:10.606910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-72e80de3-f2ee-4657-84f1-1884a939d4b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:10.614837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-72e80de3-f2ee-4657-84f1-1884a939d4b1 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1319 microversion: 2.1 time: 0.150100 Jul 21 18:07:10.615428 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 699/1407] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:10 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:10.785763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6abee4e7-c3e5-4e2a-b890-22b70dbe930a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:10.786385 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6abee4e7-c3e5-4e2a-b890-22b70dbe930a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:10.792974 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6abee4e7-c3e5-4e2a-b890-22b70dbe930a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:10.793447 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6abee4e7-c3e5-4e2a-b890-22b70dbe930a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:10.794214 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6abee4e7-c3e5-4e2a-b890-22b70dbe930a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:10.794656 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6abee4e7-c3e5-4e2a-b890-22b70dbe930a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:10.927252 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6abee4e7-c3e5-4e2a-b890-22b70dbe930a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:10.936759 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6abee4e7-c3e5-4e2a-b890-22b70dbe930a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:10.938279 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6abee4e7-c3e5-4e2a-b890-22b70dbe930a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:10.939439 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6abee4e7-c3e5-4e2a-b890-22b70dbe930a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1723 microversion: 2.20 time: 0.158140 Jul 21 18:07:10.939986 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 709/1408] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:10 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:11.631702 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7c093b5a-6bae-4ca8-a58f-6389b4394749 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:11.632333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7c093b5a-6bae-4ca8-a58f-6389b4394749 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:11.639119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c093b5a-6bae-4ca8-a58f-6389b4394749 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:11.639565 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c093b5a-6bae-4ca8-a58f-6389b4394749 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:11.640350 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c093b5a-6bae-4ca8-a58f-6389b4394749 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:11.640786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c093b5a-6bae-4ca8-a58f-6389b4394749 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:11.771489 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7c093b5a-6bae-4ca8-a58f-6389b4394749 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:11.778903 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7c093b5a-6bae-4ca8-a58f-6389b4394749 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1319 microversion: 2.1 time: 0.152270 Jul 21 18:07:11.779467 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 700/1409] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:11 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:11.958790 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0fb89468-24aa-416a-bb01-01b998ee4158 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:11.959593 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0fb89468-24aa-416a-bb01-01b998ee4158 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:11.966040 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fb89468-24aa-416a-bb01-01b998ee4158 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:11.966499 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fb89468-24aa-416a-bb01-01b998ee4158 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:11.967265 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fb89468-24aa-416a-bb01-01b998ee4158 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:11.967705 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fb89468-24aa-416a-bb01-01b998ee4158 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:12.098780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0fb89468-24aa-416a-bb01-01b998ee4158 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:12.106740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0fb89468-24aa-416a-bb01-01b998ee4158 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:12.108248 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0fb89468-24aa-416a-bb01-01b998ee4158 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:12.109421 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0fb89468-24aa-416a-bb01-01b998ee4158 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1723 microversion: 2.20 time: 0.155241 Jul 21 18:07:12.109975 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 710/1410] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:11 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:12.795242 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bca7f780-4d15-4afb-8ba6-26b16eb38cc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:12.795804 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bca7f780-4d15-4afb-8ba6-26b16eb38cc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:12.803118 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bca7f780-4d15-4afb-8ba6-26b16eb38cc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:12.803575 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bca7f780-4d15-4afb-8ba6-26b16eb38cc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:12.804640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bca7f780-4d15-4afb-8ba6-26b16eb38cc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:12.805091 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bca7f780-4d15-4afb-8ba6-26b16eb38cc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:12.938133 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bca7f780-4d15-4afb-8ba6-26b16eb38cc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:12.946308 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bca7f780-4d15-4afb-8ba6-26b16eb38cc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1319 microversion: 2.1 time: 0.154967 Jul 21 18:07:12.946874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 701/1411] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:12 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:13.127238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-08a59e9f-e786-4cbe-b68f-e183313ba27b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:13.127892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-08a59e9f-e786-4cbe-b68f-e183313ba27b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:13.135330 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-08a59e9f-e786-4cbe-b68f-e183313ba27b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:13.135782 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-08a59e9f-e786-4cbe-b68f-e183313ba27b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:13.136572 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-08a59e9f-e786-4cbe-b68f-e183313ba27b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:13.137013 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-08a59e9f-e786-4cbe-b68f-e183313ba27b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:13.263621 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-08a59e9f-e786-4cbe-b68f-e183313ba27b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:13.272113 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-08a59e9f-e786-4cbe-b68f-e183313ba27b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:13.273659 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-08a59e9f-e786-4cbe-b68f-e183313ba27b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:13.274811 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-08a59e9f-e786-4cbe-b68f-e183313ba27b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1723 microversion: 2.20 time: 0.151477 Jul 21 18:07:13.275368 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 711/1412] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:13 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:13.963666 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dc47818a-05b9-4528-af22-401042986593 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:13.964379 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dc47818a-05b9-4528-af22-401042986593 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:13.971537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc47818a-05b9-4528-af22-401042986593 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:13.973087 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc47818a-05b9-4528-af22-401042986593 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:13.973916 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc47818a-05b9-4528-af22-401042986593 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:13.974538 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc47818a-05b9-4528-af22-401042986593 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:14.037337 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-fc1e7158-a4fd-4aa7-8a74-7543ad6ae32e req-f9c7e806-cd26-4b41-8701-e732e4c41d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab08501-7006-4b72-a3fa-caaec63f9b9b", "name": "network-vif-plugged", "status": "completed", "tag": "dd3b6974-16c9-4b8e-991d-b6f68658f030"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:14.045899 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-fc1e7158-a4fd-4aa7-8a74-7543ad6ae32e req-f9c7e806-cd26-4b41-8701-e732e4c41d42 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:14.046343 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-fc1e7158-a4fd-4aa7-8a74-7543ad6ae32e req-f9c7e806-cd26-4b41-8701-e732e4c41d42 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:14.059818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-fc1e7158-a4fd-4aa7-8a74-7543ad6ae32e req-f9c7e806-cd26-4b41-8701-e732e4c41d42 service nova] Creating event network-vif-plugged:dd3b6974-16c9-4b8e-991d-b6f68658f030 for instance eab08501-7006-4b72-a3fa-caaec63f9b9b on hv-cinder-82549 Jul 21 18:07:14.064830 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-fc1e7158-a4fd-4aa7-8a74-7543ad6ae32e req-f9c7e806-cd26-4b41-8701-e732e4c41d42 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104549 Jul 21 18:07:14.065437 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 712/1413] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:07:14.071116 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-49acc1eb-4055-41ed-851b-d9ba62d022ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:14.072176 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-49acc1eb-4055-41ed-851b-d9ba62d022ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:14.078579 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-49acc1eb-4055-41ed-851b-d9ba62d022ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:14.079039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-49acc1eb-4055-41ed-851b-d9ba62d022ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:14.079817 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-49acc1eb-4055-41ed-851b-d9ba62d022ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:14.080259 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-49acc1eb-4055-41ed-851b-d9ba62d022ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:14.113391 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-49acc1eb-4055-41ed-851b-d9ba62d022ef tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046229 Jul 21 18:07:14.114149 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 713/1414] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 18:07:14 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:07:14.118313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dc47818a-05b9-4528-af22-401042986593 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:14.123592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e732aba4-837c-4b5b-a103-25a1c8d220c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:14.124365 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e732aba4-837c-4b5b-a103-25a1c8d220c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:14.126595 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dc47818a-05b9-4528-af22-401042986593 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1319 microversion: 2.1 time: 0.167327 Jul 21 18:07:14.127512 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 702/1415] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:13 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:14.131402 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e732aba4-837c-4b5b-a103-25a1c8d220c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:14.131881 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e732aba4-837c-4b5b-a103-25a1c8d220c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:14.132645 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e732aba4-837c-4b5b-a103-25a1c8d220c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:14.133081 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e732aba4-837c-4b5b-a103-25a1c8d220c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:14.165892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e732aba4-837c-4b5b-a103-25a1c8d220c1 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments/a86800f4-ab09-416d-b145-cf66ad17bf39" status: 200 len: 194 microversion: 2.1 time: 0.046146 Jul 21 18:07:14.166477 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 714/1416] 10.222.0.57 () {58 vars in 1412 bytes} [Thu Jul 21 18:07:14 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments/a86800f4-ab09-416d-b145-cf66ad17bf39 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:07:14.293331 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a0918454-dbdd-4934-86be-a1296fbf68c8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:14.293963 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a0918454-dbdd-4934-86be-a1296fbf68c8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:14.300193 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a0918454-dbdd-4934-86be-a1296fbf68c8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:14.300907 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a0918454-dbdd-4934-86be-a1296fbf68c8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:14.301875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a0918454-dbdd-4934-86be-a1296fbf68c8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:14.302594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a0918454-dbdd-4934-86be-a1296fbf68c8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:14.461542 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a0918454-dbdd-4934-86be-a1296fbf68c8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:14.473572 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a0918454-dbdd-4934-86be-a1296fbf68c8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:14.475306 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a0918454-dbdd-4934-86be-a1296fbf68c8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:14.478200 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a0918454-dbdd-4934-86be-a1296fbf68c8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1723 microversion: 2.20 time: 0.187289 Jul 21 18:07:14.484765 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 703/1417] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:14 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:15.143450 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0d4d45e2-9c31-4a1f-b257-e9ccbde081cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:15.144378 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0d4d45e2-9c31-4a1f-b257-e9ccbde081cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:15.146099 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:15.146826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=6 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:15.154108 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0d4d45e2-9c31-4a1f-b257-e9ccbde081cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:15.154558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0d4d45e2-9c31-4a1f-b257-e9ccbde081cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:15.155321 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0d4d45e2-9c31-4a1f-b257-e9ccbde081cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:15.155758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0d4d45e2-9c31-4a1f-b257-e9ccbde081cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:15.285519 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0d4d45e2-9c31-4a1f-b257-e9ccbde081cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:15.292970 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0d4d45e2-9c31-4a1f-b257-e9ccbde081cb tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1319 microversion: 2.1 time: 0.153381 Jul 21 18:07:15.293543 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 715/1418] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:15 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:15.494712 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-457d8cc1-a124-4fda-89bb-9bdffcc10ad7 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:15.495336 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-457d8cc1-a124-4fda-89bb-9bdffcc10ad7 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:15.497280 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:15.503258 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-457d8cc1-a124-4fda-89bb-9bdffcc10ad7 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:15.504526 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-457d8cc1-a124-4fda-89bb-9bdffcc10ad7 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:15.505307 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-457d8cc1-a124-4fda-89bb-9bdffcc10ad7 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:15.505746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-457d8cc1-a124-4fda-89bb-9bdffcc10ad7 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:15.542136 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bbbeebc8-c012-4474-a8d5-dd0bd82c19f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d21a17c4-c709-479d-96ce-a521d29bee82"}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:15.543257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bbbeebc8-c012-4474-a8d5-dd0bd82c19f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:15.549399 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bbbeebc8-c012-4474-a8d5-dd0bd82c19f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:15.549846 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bbbeebc8-c012-4474-a8d5-dd0bd82c19f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:15.551178 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bbbeebc8-c012-4474-a8d5-dd0bd82c19f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:15.551717 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bbbeebc8-c012-4474-a8d5-dd0bd82c19f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:15.639529 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-457d8cc1-a124-4fda-89bb-9bdffcc10ad7 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:15.647527 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-457d8cc1-a124-4fda-89bb-9bdffcc10ad7 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:15.649393 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-457d8cc1-a124-4fda-89bb-9bdffcc10ad7 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:15.650499 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-457d8cc1-a124-4fda-89bb-9bdffcc10ad7 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1723 microversion: 2.20 time: 0.159828 Jul 21 18:07:15.651043 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 704/1419] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:15 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:16.127091 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:16.137855 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bbbeebc8-c012-4474-a8d5-dd0bd82c19f4 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "POST /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.599506 Jul 21 18:07:16.138491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 716/1420] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 18:07:15 2022] POST /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments => generated 194 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:07:16.309923 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b74dc97e-f5c6-4215-8f94-ac684ce4cfc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:16.310571 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b74dc97e-f5c6-4215-8f94-ac684ce4cfc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:16.317598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b74dc97e-f5c6-4215-8f94-ac684ce4cfc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:16.318241 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b74dc97e-f5c6-4215-8f94-ac684ce4cfc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:16.318931 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b74dc97e-f5c6-4215-8f94-ac684ce4cfc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:16.319680 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b74dc97e-f5c6-4215-8f94-ac684ce4cfc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:16.451953 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b74dc97e-f5c6-4215-8f94-ac684ce4cfc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:16.459323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b74dc97e-f5c6-4215-8f94-ac684ce4cfc7 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1508 microversion: 2.1 time: 0.153257 Jul 21 18:07:16.459888 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 705/1421] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:16 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:16.476839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-147203d1-b105-4ebd-8938-c501250b536a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9588eeac-c7a4-43b1-99b4-5b1e3c03e205", "device": "/dev/sdb"}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:16.478177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-147203d1-b105-4ebd-8938-c501250b536a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:16.485617 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-147203d1-b105-4ebd-8938-c501250b536a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:16.486072 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-147203d1-b105-4ebd-8938-c501250b536a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:16.486836 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-147203d1-b105-4ebd-8938-c501250b536a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:16.487283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-147203d1-b105-4ebd-8938-c501250b536a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:16.670683 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7c17f7b9-d13b-46a5-a593-9ce9d60a598e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:16.671507 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7c17f7b9-d13b-46a5-a593-9ce9d60a598e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:16.679384 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c17f7b9-d13b-46a5-a593-9ce9d60a598e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:16.679930 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c17f7b9-d13b-46a5-a593-9ce9d60a598e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:16.680819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c17f7b9-d13b-46a5-a593-9ce9d60a598e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:16.681360 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c17f7b9-d13b-46a5-a593-9ce9d60a598e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:16.758662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-147203d1-b105-4ebd-8938-c501250b536a tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "POST /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286550 Jul 21 18:07:16.759280 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 717/1422] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 18:07:16 2022] POST /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:07:16.853678 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7c17f7b9-d13b-46a5-a593-9ce9d60a598e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:16.864602 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7c17f7b9-d13b-46a5-a593-9ce9d60a598e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:16.866100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7c17f7b9-d13b-46a5-a593-9ce9d60a598e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:16.867864 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7c17f7b9-d13b-46a5-a593-9ce9d60a598e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1723 microversion: 2.20 time: 0.202013 Jul 21 18:07:16.868436 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 706/1423] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:16 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:17.886827 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-58ac6d09-2a5b-43be-8540-3e658de89cc4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:17.887533 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-58ac6d09-2a5b-43be-8540-3e658de89cc4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:17.894403 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-58ac6d09-2a5b-43be-8540-3e658de89cc4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:17.894855 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-58ac6d09-2a5b-43be-8540-3e658de89cc4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:17.895620 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-58ac6d09-2a5b-43be-8540-3e658de89cc4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:17.896062 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-58ac6d09-2a5b-43be-8540-3e658de89cc4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:18.030404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-58ac6d09-2a5b-43be-8540-3e658de89cc4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:18.039393 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-58ac6d09-2a5b-43be-8540-3e658de89cc4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:18.040947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-58ac6d09-2a5b-43be-8540-3e658de89cc4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:18.042116 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-58ac6d09-2a5b-43be-8540-3e658de89cc4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1744 microversion: 2.20 time: 0.159971 Jul 21 18:07:18.042682 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 718/1424] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:17 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:19.060696 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-311adddc-e5de-4727-991d-b2146c645c52 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:19.061312 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-311adddc-e5de-4727-991d-b2146c645c52 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:19.068011 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-311adddc-e5de-4727-991d-b2146c645c52 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:19.068435 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-311adddc-e5de-4727-991d-b2146c645c52 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:19.069196 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-311adddc-e5de-4727-991d-b2146c645c52 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:19.069630 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-311adddc-e5de-4727-991d-b2146c645c52 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:19.199722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-311adddc-e5de-4727-991d-b2146c645c52 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:19.207978 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-311adddc-e5de-4727-991d-b2146c645c52 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:19.209514 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-311adddc-e5de-4727-991d-b2146c645c52 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:19.210662 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-311adddc-e5de-4727-991d-b2146c645c52 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1744 microversion: 2.20 time: 0.153976 Jul 21 18:07:19.211213 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 707/1425] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:19 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:20.228535 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a8aae021-3956-4a45-91a9-9dbcb4bdd8e8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:20.229892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a8aae021-3956-4a45-91a9-9dbcb4bdd8e8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:20.237380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a8aae021-3956-4a45-91a9-9dbcb4bdd8e8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:20.237897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a8aae021-3956-4a45-91a9-9dbcb4bdd8e8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:20.238692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a8aae021-3956-4a45-91a9-9dbcb4bdd8e8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:20.239167 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a8aae021-3956-4a45-91a9-9dbcb4bdd8e8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:20.384600 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a8aae021-3956-4a45-91a9-9dbcb4bdd8e8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:20.392986 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a8aae021-3956-4a45-91a9-9dbcb4bdd8e8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:20.395391 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a8aae021-3956-4a45-91a9-9dbcb4bdd8e8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:20.396634 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a8aae021-3956-4a45-91a9-9dbcb4bdd8e8 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1739 microversion: 2.20 time: 0.171907 Jul 21 18:07:20.397458 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 719/1426] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:20 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:21.415955 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7e59b82d-4b56-426e-bb12-0b16e165a01c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:21.417372 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7e59b82d-4b56-426e-bb12-0b16e165a01c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:21.424343 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e59b82d-4b56-426e-bb12-0b16e165a01c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:21.425365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e59b82d-4b56-426e-bb12-0b16e165a01c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:21.426563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e59b82d-4b56-426e-bb12-0b16e165a01c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:21.427278 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7e59b82d-4b56-426e-bb12-0b16e165a01c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:21.590712 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7e59b82d-4b56-426e-bb12-0b16e165a01c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:21.601767 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7e59b82d-4b56-426e-bb12-0b16e165a01c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:21.603627 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7e59b82d-4b56-426e-bb12-0b16e165a01c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:21.604899 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7e59b82d-4b56-426e-bb12-0b16e165a01c tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1739 microversion: 2.20 time: 0.193106 Jul 21 18:07:21.605636 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 708/1427] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:21 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:22.024390 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-02c53f6d-373e-4e46-acfd-3593675cb4b1 req-d08525cb-8df4-4854-9cd6-2182ba7f6413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f527049-c7ec-49e6-91e1-117b50b70c43", "name": "network-vif-plugged", "status": "completed", "tag": "185dcd5b-b337-4222-acff-146ba91a9e43"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:22.034582 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-02c53f6d-373e-4e46-acfd-3593675cb4b1 req-d08525cb-8df4-4854-9cd6-2182ba7f6413 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:22.035395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-02c53f6d-373e-4e46-acfd-3593675cb4b1 req-d08525cb-8df4-4854-9cd6-2182ba7f6413 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:22.049274 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-02c53f6d-373e-4e46-acfd-3593675cb4b1 req-d08525cb-8df4-4854-9cd6-2182ba7f6413 service nova] Creating event network-vif-plugged:185dcd5b-b337-4222-acff-146ba91a9e43 for instance 0f527049-c7ec-49e6-91e1-117b50b70c43 on hv-cinder-82549 Jul 21 18:07:22.056504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-02c53f6d-373e-4e46-acfd-3593675cb4b1 req-d08525cb-8df4-4854-9cd6-2182ba7f6413 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044401 Jul 21 18:07:22.057467 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 720/1428] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:07:22.623856 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-92bcdadb-0172-49c4-bd1b-7f30b9264eb3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:22.624885 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-92bcdadb-0172-49c4-bd1b-7f30b9264eb3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:22.633990 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92bcdadb-0172-49c4-bd1b-7f30b9264eb3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:22.634788 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92bcdadb-0172-49c4-bd1b-7f30b9264eb3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:22.635645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92bcdadb-0172-49c4-bd1b-7f30b9264eb3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:22.636167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92bcdadb-0172-49c4-bd1b-7f30b9264eb3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:22.792568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-92bcdadb-0172-49c4-bd1b-7f30b9264eb3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:22.801497 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-92bcdadb-0172-49c4-bd1b-7f30b9264eb3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:22.803006 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-92bcdadb-0172-49c4-bd1b-7f30b9264eb3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:22.804528 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-92bcdadb-0172-49c4-bd1b-7f30b9264eb3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1739 microversion: 2.20 time: 0.184989 Jul 21 18:07:22.815350 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 709/1429] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:22 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:23.696394 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-679e023b-48b4-4612-975a-6302ac4497bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:23.697987 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-679e023b-48b4-4612-975a-6302ac4497bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:23.705697 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-679e023b-48b4-4612-975a-6302ac4497bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:23.706508 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-679e023b-48b4-4612-975a-6302ac4497bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:23.707574 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-679e023b-48b4-4612-975a-6302ac4497bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:23.708146 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-679e023b-48b4-4612-975a-6302ac4497bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:23.747247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-679e023b-48b4-4612-975a-6302ac4497bc tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056722 Jul 21 18:07:23.753174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 721/1430] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 18:07:23 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:07:23.823901 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ba7564fa-d2af-40a5-8bcd-635f317fc114 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:23.825239 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ba7564fa-d2af-40a5-8bcd-635f317fc114 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:23.833339 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ba7564fa-d2af-40a5-8bcd-635f317fc114 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:23.834060 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ba7564fa-d2af-40a5-8bcd-635f317fc114 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:23.835044 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ba7564fa-d2af-40a5-8bcd-635f317fc114 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:23.835686 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ba7564fa-d2af-40a5-8bcd-635f317fc114 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:23.855826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:23.897522 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-745586d9-7a66-4346-8bee-e20736772120 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:23.898161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-745586d9-7a66-4346-8bee-e20736772120 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:23.910253 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-745586d9-7a66-4346-8bee-e20736772120 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:23.911122 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-745586d9-7a66-4346-8bee-e20736772120 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:23.912247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-745586d9-7a66-4346-8bee-e20736772120 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:23.912920 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-745586d9-7a66-4346-8bee-e20736772120 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:23.950721 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-745586d9-7a66-4346-8bee-e20736772120 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments/a86800f4-ab09-416d-b145-cf66ad17bf39" status: 200 len: 194 microversion: 2.1 time: 0.056865 Jul 21 18:07:23.951428 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 722/1431] 10.222.0.57 () {58 vars in 1412 bytes} [Thu Jul 21 18:07:23 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments/a86800f4-ab09-416d-b145-cf66ad17bf39 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:07:23.963300 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6bc3e69d-038c-44f2-aa38-eb8e3a1f5989 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:23.966232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6bc3e69d-038c-44f2-aa38-eb8e3a1f5989 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:23.976047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6bc3e69d-038c-44f2-aa38-eb8e3a1f5989 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:23.976674 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6bc3e69d-038c-44f2-aa38-eb8e3a1f5989 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:23.977544 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6bc3e69d-038c-44f2-aa38-eb8e3a1f5989 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:23.978079 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6bc3e69d-038c-44f2-aa38-eb8e3a1f5989 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:24.027038 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ba7564fa-d2af-40a5-8bcd-635f317fc114 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:24.043798 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ba7564fa-d2af-40a5-8bcd-635f317fc114 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:24.048271 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ba7564fa-d2af-40a5-8bcd-635f317fc114 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:24.051568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ba7564fa-d2af-40a5-8bcd-635f317fc114 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1739 microversion: 2.20 time: 0.230479 Jul 21 18:07:24.053154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 710/1432] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:23 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:24.136484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.objects.instance [None req-6bc3e69d-038c-44f2-aa38-eb8e3a1f5989 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lazy-loading 'services' on Instance uuid f826a69d-58cb-4b71-9282-0678122b31d8 {{(pid=124381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 18:07:24.283171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6bc3e69d-038c-44f2-aa38-eb8e3a1f5989 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments/a86800f4-ab09-416d-b145-cf66ad17bf39" status: 202 len: 0 microversion: 2.1 time: 0.325680 Jul 21 18:07:24.284939 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 723/1433] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 18:07:23 2022] DELETE /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments/a86800f4-ab09-416d-b145-cf66ad17bf39 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 18:07:25.071963 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9226f944-82bc-43ef-be69-e8a70fec0f19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:25.073248 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9226f944-82bc-43ef-be69-e8a70fec0f19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:25.083850 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9226f944-82bc-43ef-be69-e8a70fec0f19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:25.084332 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9226f944-82bc-43ef-be69-e8a70fec0f19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:25.085126 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9226f944-82bc-43ef-be69-e8a70fec0f19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:25.085566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9226f944-82bc-43ef-be69-e8a70fec0f19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:25.250288 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9226f944-82bc-43ef-be69-e8a70fec0f19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:25.263633 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9226f944-82bc-43ef-be69-e8a70fec0f19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:25.265546 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9226f944-82bc-43ef-be69-e8a70fec0f19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:25.266719 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9226f944-82bc-43ef-be69-e8a70fec0f19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1739 microversion: 2.20 time: 0.199471 Jul 21 18:07:25.267615 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 711/1434] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:25 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:26.288976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-842d4952-25ba-492a-b51b-928bd6d6595d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:26.289683 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-842d4952-25ba-492a-b51b-928bd6d6595d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:26.296001 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-842d4952-25ba-492a-b51b-928bd6d6595d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:26.296828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-842d4952-25ba-492a-b51b-928bd6d6595d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:26.297780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-842d4952-25ba-492a-b51b-928bd6d6595d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:26.298386 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-842d4952-25ba-492a-b51b-928bd6d6595d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:26.496933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-842d4952-25ba-492a-b51b-928bd6d6595d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:26.506558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-842d4952-25ba-492a-b51b-928bd6d6595d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:26.508346 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-842d4952-25ba-492a-b51b-928bd6d6595d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:26.509718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-842d4952-25ba-492a-b51b-928bd6d6595d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1739 microversion: 2.20 time: 0.227087 Jul 21 18:07:26.510783 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 724/1435] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:26 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:27.531829 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0072fb67-56d0-4ce3-80b7-84beb07ad51f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:27.532375 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0072fb67-56d0-4ce3-80b7-84beb07ad51f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:27.547254 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0072fb67-56d0-4ce3-80b7-84beb07ad51f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:27.547915 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0072fb67-56d0-4ce3-80b7-84beb07ad51f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:27.548593 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0072fb67-56d0-4ce3-80b7-84beb07ad51f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:27.550046 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0072fb67-56d0-4ce3-80b7-84beb07ad51f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:27.704046 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0072fb67-56d0-4ce3-80b7-84beb07ad51f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:27.712759 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0072fb67-56d0-4ce3-80b7-84beb07ad51f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:27.714659 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0072fb67-56d0-4ce3-80b7-84beb07ad51f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:27.715968 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0072fb67-56d0-4ce3-80b7-84beb07ad51f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1739 microversion: 2.20 time: 0.191362 Jul 21 18:07:27.716616 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 712/1436] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:27 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:28.734575 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2fd83975-879d-4a18-b8d3-12aba9584893 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:28.735884 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2fd83975-879d-4a18-b8d3-12aba9584893 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:28.742698 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2fd83975-879d-4a18-b8d3-12aba9584893 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:28.743437 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2fd83975-879d-4a18-b8d3-12aba9584893 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:28.744459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2fd83975-879d-4a18-b8d3-12aba9584893 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:28.745300 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2fd83975-879d-4a18-b8d3-12aba9584893 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:28.901427 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2fd83975-879d-4a18-b8d3-12aba9584893 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:28.910616 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2fd83975-879d-4a18-b8d3-12aba9584893 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:28.912134 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-2fd83975-879d-4a18-b8d3-12aba9584893 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:28.913352 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2fd83975-879d-4a18-b8d3-12aba9584893 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1739 microversion: 2.20 time: 0.183151 Jul 21 18:07:28.924322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 725/1437] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:28 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 18:07:29.931367 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-63feb01c-4854-4c42-90ad-6b9ea14a50f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:29.931965 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-63feb01c-4854-4c42-90ad-6b9ea14a50f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:29.938608 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63feb01c-4854-4c42-90ad-6b9ea14a50f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:29.939054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63feb01c-4854-4c42-90ad-6b9ea14a50f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:29.939875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63feb01c-4854-4c42-90ad-6b9ea14a50f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:29.940284 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63feb01c-4854-4c42-90ad-6b9ea14a50f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:30.072958 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-63feb01c-4854-4c42-90ad-6b9ea14a50f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:30.081627 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-63feb01c-4854-4c42-90ad-6b9ea14a50f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:30.083130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-63feb01c-4854-4c42-90ad-6b9ea14a50f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:30.084340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-63feb01c-4854-4c42-90ad-6b9ea14a50f3 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1721 microversion: 2.20 time: 0.157144 Jul 21 18:07:30.084901 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 713/1438] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:29 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:31.102855 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-95c2c552-813b-482d-b753-4bbd790395c2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:31.103471 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-95c2c552-813b-482d-b753-4bbd790395c2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:31.109919 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-95c2c552-813b-482d-b753-4bbd790395c2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:31.110372 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-95c2c552-813b-482d-b753-4bbd790395c2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:31.111129 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-95c2c552-813b-482d-b753-4bbd790395c2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:31.111592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-95c2c552-813b-482d-b753-4bbd790395c2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:31.242126 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-95c2c552-813b-482d-b753-4bbd790395c2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:31.250187 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-95c2c552-813b-482d-b753-4bbd790395c2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:31.251713 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-95c2c552-813b-482d-b753-4bbd790395c2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:31.253870 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-95c2c552-813b-482d-b753-4bbd790395c2 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1721 microversion: 2.20 time: 0.154667 Jul 21 18:07:31.254523 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 726/1439] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:31 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:32.273346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-11df2bb9-3bf8-475e-a534-e1c3938322c4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:32.273969 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-11df2bb9-3bf8-475e-a534-e1c3938322c4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:32.280480 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11df2bb9-3bf8-475e-a534-e1c3938322c4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:32.280932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11df2bb9-3bf8-475e-a534-e1c3938322c4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:32.281728 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11df2bb9-3bf8-475e-a534-e1c3938322c4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:32.282166 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11df2bb9-3bf8-475e-a534-e1c3938322c4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:32.409849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11df2bb9-3bf8-475e-a534-e1c3938322c4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:32.418348 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11df2bb9-3bf8-475e-a534-e1c3938322c4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:32.419848 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11df2bb9-3bf8-475e-a534-e1c3938322c4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:32.421028 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-11df2bb9-3bf8-475e-a534-e1c3938322c4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1721 microversion: 2.20 time: 0.151597 Jul 21 18:07:32.421587 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 714/1440] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:32 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:33.438874 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c3efa48d-9a97-4385-9f1a-5abf620b7765 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:33.439489 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c3efa48d-9a97-4385-9f1a-5abf620b7765 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:33.445996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c3efa48d-9a97-4385-9f1a-5abf620b7765 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:33.446446 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c3efa48d-9a97-4385-9f1a-5abf620b7765 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:33.447208 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c3efa48d-9a97-4385-9f1a-5abf620b7765 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:33.447647 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c3efa48d-9a97-4385-9f1a-5abf620b7765 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:33.577495 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c3efa48d-9a97-4385-9f1a-5abf620b7765 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:33.586296 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c3efa48d-9a97-4385-9f1a-5abf620b7765 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:33.587808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c3efa48d-9a97-4385-9f1a-5abf620b7765 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:33.588998 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c3efa48d-9a97-4385-9f1a-5abf620b7765 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1721 microversion: 2.20 time: 0.154013 Jul 21 18:07:33.589561 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 727/1441] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:33 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:34.036782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-a5589c3a-bcf0-4202-9cc9-c726aa510a2e req-20596e1e-d7a4-4c51-87c8-08ceac8b2be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f527049-c7ec-49e6-91e1-117b50b70c43", "name": "network-vif-unplugged", "status": "completed", "tag": "185dcd5b-b337-4222-acff-146ba91a9e43"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:34.046363 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-a5589c3a-bcf0-4202-9cc9-c726aa510a2e req-20596e1e-d7a4-4c51-87c8-08ceac8b2be1 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:34.046840 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-a5589c3a-bcf0-4202-9cc9-c726aa510a2e req-20596e1e-d7a4-4c51-87c8-08ceac8b2be1 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:34.058992 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-a5589c3a-bcf0-4202-9cc9-c726aa510a2e req-20596e1e-d7a4-4c51-87c8-08ceac8b2be1 service nova] Creating event network-vif-unplugged:185dcd5b-b337-4222-acff-146ba91a9e43 for instance 0f527049-c7ec-49e6-91e1-117b50b70c43 on hv-cinder-82549 Jul 21 18:07:34.064959 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-a5589c3a-bcf0-4202-9cc9-c726aa510a2e req-20596e1e-d7a4-4c51-87c8-08ceac8b2be1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032428 Jul 21 18:07:34.065706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 715/1442] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:07:34.607738 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-48810baa-20dd-4b4f-9e02-07b619b8a112 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:34.608307 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-48810baa-20dd-4b4f-9e02-07b619b8a112 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:34.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:34.616178 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-48810baa-20dd-4b4f-9e02-07b619b8a112 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:34.616655 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-48810baa-20dd-4b4f-9e02-07b619b8a112 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:34.617417 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-48810baa-20dd-4b4f-9e02-07b619b8a112 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:34.617848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-48810baa-20dd-4b4f-9e02-07b619b8a112 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:34.749960 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-48810baa-20dd-4b4f-9e02-07b619b8a112 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:34.758356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-48810baa-20dd-4b4f-9e02-07b619b8a112 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:34.759857 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-48810baa-20dd-4b4f-9e02-07b619b8a112 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:34.761038 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-48810baa-20dd-4b4f-9e02-07b619b8a112 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1721 microversion: 2.20 time: 0.157323 Jul 21 18:07:34.761598 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 728/1443] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:34 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:34.929164 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4d9c2ece-710b-48ff-961d-eec2c9191acb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:34.929746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4d9c2ece-710b-48ff-961d-eec2c9191acb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:34.931675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=49 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:34.937217 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d9c2ece-710b-48ff-961d-eec2c9191acb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:34.937740 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d9c2ece-710b-48ff-961d-eec2c9191acb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:34.938601 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d9c2ece-710b-48ff-961d-eec2c9191acb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:34.939105 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d9c2ece-710b-48ff-961d-eec2c9191acb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:34.970253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4d9c2ece-710b-48ff-961d-eec2c9191acb tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments/d21a17c4-c709-479d-96ce-a521d29bee82" status: 200 len: 194 microversion: 2.1 time: 0.045769 Jul 21 18:07:34.970872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 716/1444] 10.222.0.57 () {58 vars in 1412 bytes} [Thu Jul 21 18:07:34 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments/d21a17c4-c709-479d-96ce-a521d29bee82 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:07:34.980511 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b04a0ba6-04ee-46fe-8b9d-b785860c2d32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:34.981011 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b04a0ba6-04ee-46fe-8b9d-b785860c2d32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:34.987342 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b04a0ba6-04ee-46fe-8b9d-b785860c2d32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:34.987805 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b04a0ba6-04ee-46fe-8b9d-b785860c2d32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:34.989177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b04a0ba6-04ee-46fe-8b9d-b785860c2d32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:34.989177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b04a0ba6-04ee-46fe-8b9d-b785860c2d32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:35.084264 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.objects.instance [None req-b04a0ba6-04ee-46fe-8b9d-b785860c2d32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lazy-loading 'services' on Instance uuid f826a69d-58cb-4b71-9282-0678122b31d8 {{(pid=124381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 18:07:35.170443 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b04a0ba6-04ee-46fe-8b9d-b785860c2d32 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments/d21a17c4-c709-479d-96ce-a521d29bee82" status: 202 len: 0 microversion: 2.1 time: 0.193706 Jul 21 18:07:35.171037 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 729/1445] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 18:07:34 2022] DELETE /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments/d21a17c4-c709-479d-96ce-a521d29bee82 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:07:35.778930 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f6fb7afd-9e8e-4159-9d04-48f2e3961062 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:35.780289 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f6fb7afd-9e8e-4159-9d04-48f2e3961062 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:35.794204 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6fb7afd-9e8e-4159-9d04-48f2e3961062 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:35.794657 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6fb7afd-9e8e-4159-9d04-48f2e3961062 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:35.795445 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6fb7afd-9e8e-4159-9d04-48f2e3961062 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:35.795886 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f6fb7afd-9e8e-4159-9d04-48f2e3961062 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:35.933525 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f6fb7afd-9e8e-4159-9d04-48f2e3961062 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:35.942234 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f6fb7afd-9e8e-4159-9d04-48f2e3961062 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:35.943739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f6fb7afd-9e8e-4159-9d04-48f2e3961062 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:35.944928 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f6fb7afd-9e8e-4159-9d04-48f2e3961062 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1721 microversion: 2.20 time: 0.169900 Jul 21 18:07:35.945491 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 717/1446] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:35 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:36.964052 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-25392f6b-45c9-48f0-93ca-11071d9c1fa1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:36.964793 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-25392f6b-45c9-48f0-93ca-11071d9c1fa1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:36.971164 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25392f6b-45c9-48f0-93ca-11071d9c1fa1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:36.971605 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25392f6b-45c9-48f0-93ca-11071d9c1fa1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:36.972406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25392f6b-45c9-48f0-93ca-11071d9c1fa1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:36.972843 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-25392f6b-45c9-48f0-93ca-11071d9c1fa1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:37.105410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-25392f6b-45c9-48f0-93ca-11071d9c1fa1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:37.113829 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-25392f6b-45c9-48f0-93ca-11071d9c1fa1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:37.115323 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-25392f6b-45c9-48f0-93ca-11071d9c1fa1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:37.116499 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-25392f6b-45c9-48f0-93ca-11071d9c1fa1 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1721 microversion: 2.20 time: 0.157315 Jul 21 18:07:37.117050 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 730/1447] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:36 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:38.134781 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-834f130f-fb51-46e6-96d7-92ffc64336aa tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:38.135400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-834f130f-fb51-46e6-96d7-92ffc64336aa tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:38.142698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-834f130f-fb51-46e6-96d7-92ffc64336aa tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:38.143634 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-834f130f-fb51-46e6-96d7-92ffc64336aa tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:38.144441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-834f130f-fb51-46e6-96d7-92ffc64336aa tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:38.144880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-834f130f-fb51-46e6-96d7-92ffc64336aa tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:38.276464 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-834f130f-fb51-46e6-96d7-92ffc64336aa tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:38.284736 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-834f130f-fb51-46e6-96d7-92ffc64336aa tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:38.286241 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-834f130f-fb51-46e6-96d7-92ffc64336aa tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:38.287388 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-834f130f-fb51-46e6-96d7-92ffc64336aa tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1724 microversion: 2.20 time: 0.156517 Jul 21 18:07:38.287936 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 718/1448] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:38 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:38.305721 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-adc524c7-3453-4055-85f8-2c60eea1a921 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef9a0b62-481a-4c42-8ae4-8674079b7b71"}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:38.306795 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-adc524c7-3453-4055-85f8-2c60eea1a921 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:38.313376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-adc524c7-3453-4055-85f8-2c60eea1a921 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:38.313827 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-adc524c7-3453-4055-85f8-2c60eea1a921 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:38.314590 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-adc524c7-3453-4055-85f8-2c60eea1a921 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:38.316211 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-adc524c7-3453-4055-85f8-2c60eea1a921 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:38.335453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:38.601224 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-adc524c7-3453-4055-85f8-2c60eea1a921 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "POST /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299805 Jul 21 18:07:38.601829 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 731/1449] 10.222.0.57 () {62 vars in 1363 bytes} [Thu Jul 21 18:07:38 2022] POST /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 18:07:38.713991 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-00b1f700-4e1a-4ac3-83fb-279e4098603d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:38.714488 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-00b1f700-4e1a-4ac3-83fb-279e4098603d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:38.720418 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00b1f700-4e1a-4ac3-83fb-279e4098603d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:38.720888 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00b1f700-4e1a-4ac3-83fb-279e4098603d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:38.722374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00b1f700-4e1a-4ac3-83fb-279e4098603d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:38.722815 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00b1f700-4e1a-4ac3-83fb-279e4098603d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:39.028875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-00b1f700-4e1a-4ac3-83fb-279e4098603d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/os-volume_attachments/ef9a0b62-481a-4c42-8ae4-8674079b7b71" status: 202 len: 0 microversion: 2.20 time: 0.318645 Jul 21 18:07:39.029489 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 719/1450] 10.222.0.57 () {60 vars in 1456 bytes} [Thu Jul 21 18:07:38 2022] DELETE /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/os-volume_attachments/ef9a0b62-481a-4c42-8ae4-8674079b7b71 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 18:07:39.086918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6d688a48-47f4-4fe3-affe-51a3106c7277 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:39.087500 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6d688a48-47f4-4fe3-affe-51a3106c7277 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:39.094516 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d688a48-47f4-4fe3-affe-51a3106c7277 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:39.094977 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d688a48-47f4-4fe3-affe-51a3106c7277 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:39.095760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d688a48-47f4-4fe3-affe-51a3106c7277 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:39.096255 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d688a48-47f4-4fe3-affe-51a3106c7277 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:39.199048 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6d688a48-47f4-4fe3-affe-51a3106c7277 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "POST /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/action" status: 202 len: 0 microversion: 2.20 time: 0.116120 Jul 21 18:07:39.199816 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 732/1451] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jul 21 18:07:39 2022] POST /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 18:07:39.209147 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-96b83224-bc7d-4491-a999-05aac0452678 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:39.211057 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-96b83224-bc7d-4491-a999-05aac0452678 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:39.223997 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-96b83224-bc7d-4491-a999-05aac0452678 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:39.224650 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-96b83224-bc7d-4491-a999-05aac0452678 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:39.228906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-96b83224-bc7d-4491-a999-05aac0452678 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:39.229523 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-96b83224-bc7d-4491-a999-05aac0452678 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:39.377869 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-96b83224-bc7d-4491-a999-05aac0452678 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:39.389081 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-96b83224-bc7d-4491-a999-05aac0452678 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:39.390630 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-96b83224-bc7d-4491-a999-05aac0452678 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:39.391806 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-96b83224-bc7d-4491-a999-05aac0452678 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1672 microversion: 2.20 time: 0.187876 Jul 21 18:07:39.392367 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 720/1452] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:39 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:39.512204 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-92fb7177-c760-4796-bd8d-f36ad1d6ebdd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:39.519920 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-92fb7177-c760-4796-bd8d-f36ad1d6ebdd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:39.527464 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92fb7177-c760-4796-bd8d-f36ad1d6ebdd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:39.527808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92fb7177-c760-4796-bd8d-f36ad1d6ebdd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:39.528642 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92fb7177-c760-4796-bd8d-f36ad1d6ebdd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:39.529088 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-92fb7177-c760-4796-bd8d-f36ad1d6ebdd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:39.561682 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-92fb7177-c760-4796-bd8d-f36ad1d6ebdd tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055379 Jul 21 18:07:39.562347 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 733/1453] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 18:07:39 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 18:07:39.671114 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-64ee64a3-7eca-4ec2-aed8-15a5f040c899 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:39.672416 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-64ee64a3-7eca-4ec2-aed8-15a5f040c899 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:39.680223 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64ee64a3-7eca-4ec2-aed8-15a5f040c899 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:39.680789 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64ee64a3-7eca-4ec2-aed8-15a5f040c899 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:39.681635 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64ee64a3-7eca-4ec2-aed8-15a5f040c899 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:39.682130 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64ee64a3-7eca-4ec2-aed8-15a5f040c899 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:39.711200 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-64ee64a3-7eca-4ec2-aed8-15a5f040c899 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043913 Jul 21 18:07:39.711756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 721/1454] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 18:07:39 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 18:07:39.769125 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2e4318fa-98a7-47b7-af0d-748400f24bc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:39.769827 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2e4318fa-98a7-47b7-af0d-748400f24bc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:39.775931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e4318fa-98a7-47b7-af0d-748400f24bc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:39.776506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e4318fa-98a7-47b7-af0d-748400f24bc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:39.777383 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e4318fa-98a7-47b7-af0d-748400f24bc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:39.777890 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-2e4318fa-98a7-47b7-af0d-748400f24bc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:39.806505 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-2e4318fa-98a7-47b7-af0d-748400f24bc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Going to try to terminate instance {{(pid=124381) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 18:07:39.893691 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2e4318fa-98a7-47b7-af0d-748400f24bc7 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 204 len: 0 microversion: 2.1 time: 0.128289 Jul 21 18:07:39.894564 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 734/1455] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:07:39 2022] DELETE /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 18:07:39.902691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-07b51f6d-59b7-4722-892b-20ffbf803ee5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:39.903385 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-07b51f6d-59b7-4722-892b-20ffbf803ee5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:39.912703 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07b51f6d-59b7-4722-892b-20ffbf803ee5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:39.912703 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07b51f6d-59b7-4722-892b-20ffbf803ee5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:39.912703 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07b51f6d-59b7-4722-892b-20ffbf803ee5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:39.912985 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07b51f6d-59b7-4722-892b-20ffbf803ee5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:40.077219 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-07b51f6d-59b7-4722-892b-20ffbf803ee5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:40.085800 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-07b51f6d-59b7-4722-892b-20ffbf803ee5 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1674 microversion: 2.1 time: 0.186823 Jul 21 18:07:40.086382 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 722/1456] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:39 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1674 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:40.412558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ac5b2235-0ba3-47e8-b4b2-dad211b75d0d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:40.413252 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ac5b2235-0ba3-47e8-b4b2-dad211b75d0d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:40.419376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ac5b2235-0ba3-47e8-b4b2-dad211b75d0d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:40.419807 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ac5b2235-0ba3-47e8-b4b2-dad211b75d0d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:40.420586 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ac5b2235-0ba3-47e8-b4b2-dad211b75d0d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:40.421019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ac5b2235-0ba3-47e8-b4b2-dad211b75d0d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:40.550835 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ac5b2235-0ba3-47e8-b4b2-dad211b75d0d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:40.559080 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ac5b2235-0ba3-47e8-b4b2-dad211b75d0d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:40.560632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ac5b2235-0ba3-47e8-b4b2-dad211b75d0d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:40.561803 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ac5b2235-0ba3-47e8-b4b2-dad211b75d0d tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1672 microversion: 2.20 time: 0.153441 Jul 21 18:07:40.562369 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 735/1457] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:40 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:41.105882 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cdcd4e57-48af-43d9-9651-67a854bbf5d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:41.106545 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cdcd4e57-48af-43d9-9651-67a854bbf5d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:41.114867 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cdcd4e57-48af-43d9-9651-67a854bbf5d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:41.115772 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cdcd4e57-48af-43d9-9651-67a854bbf5d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:41.116671 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cdcd4e57-48af-43d9-9651-67a854bbf5d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:41.117184 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cdcd4e57-48af-43d9-9651-67a854bbf5d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:41.269783 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cdcd4e57-48af-43d9-9651-67a854bbf5d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:41.281099 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cdcd4e57-48af-43d9-9651-67a854bbf5d9 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1674 microversion: 2.1 time: 0.179852 Jul 21 18:07:41.281861 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 723/1458] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:41 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:41.580745 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-069c042e-a3c7-4240-86c8-17ec04db6252 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:41.581526 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-069c042e-a3c7-4240-86c8-17ec04db6252 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:41.588822 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-069c042e-a3c7-4240-86c8-17ec04db6252 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:41.589355 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-069c042e-a3c7-4240-86c8-17ec04db6252 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:41.590197 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-069c042e-a3c7-4240-86c8-17ec04db6252 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:41.590706 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-069c042e-a3c7-4240-86c8-17ec04db6252 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:41.741918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-069c042e-a3c7-4240-86c8-17ec04db6252 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:41.749962 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-069c042e-a3c7-4240-86c8-17ec04db6252 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:41.751464 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-069c042e-a3c7-4240-86c8-17ec04db6252 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:41.752645 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-069c042e-a3c7-4240-86c8-17ec04db6252 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.175878 Jul 21 18:07:41.753379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 736/1459] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:41 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:42.301569 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-77cf520e-0946-4fa7-a9a8-4d91edd95431 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:42.303054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-77cf520e-0946-4fa7-a9a8-4d91edd95431 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:42.310286 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77cf520e-0946-4fa7-a9a8-4d91edd95431 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:42.321974 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-e469a851-57e6-40e8-84df-1af498dfd91b req-e1a7560e-18a2-494a-8b67-0d41ead3b14b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f826a69d-58cb-4b71-9282-0678122b31d8", "name": "network-vif-deleted", "tag": "06af3328-5150-47b4-b7bb-980ff6100804"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:42.333139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77cf520e-0946-4fa7-a9a8-4d91edd95431 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:42.335863 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77cf520e-0946-4fa7-a9a8-4d91edd95431 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:42.336350 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-77cf520e-0946-4fa7-a9a8-4d91edd95431 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:42.349047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-e469a851-57e6-40e8-84df-1af498dfd91b req-e1a7560e-18a2-494a-8b67-0d41ead3b14b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:42.349964 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-e469a851-57e6-40e8-84df-1af498dfd91b req-e1a7560e-18a2-494a-8b67-0d41ead3b14b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:42.368148 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-e469a851-57e6-40e8-84df-1af498dfd91b req-e1a7560e-18a2-494a-8b67-0d41ead3b14b service nova] Creating event network-vif-deleted:06af3328-5150-47b4-b7bb-980ff6100804 for instance f826a69d-58cb-4b71-9282-0678122b31d8 on hv-cinder-82549 Jul 21 18:07:42.374601 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-e469a851-57e6-40e8-84df-1af498dfd91b req-e1a7560e-18a2-494a-8b67-0d41ead3b14b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060641 Jul 21 18:07:42.379562 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 737/1460] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:07:42.429997 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-77cf520e-0946-4fa7-a9a8-4d91edd95431 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea3ea36439143b8a55f181170efc14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5161720524a4488aa42e383597d30144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:42.438459 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-77cf520e-0946-4fa7-a9a8-4d91edd95431 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 200 len: 1321 microversion: 2.1 time: 0.141658 Jul 21 18:07:42.447979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 724/1461] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:42 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:42.543396 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-55b4c84f-bff9-4efb-83ca-0ecd96725e4b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:42.543975 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-55b4c84f-bff9-4efb-83ca-0ecd96725e4b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:42.550221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-55b4c84f-bff9-4efb-83ca-0ecd96725e4b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:42.550729 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-55b4c84f-bff9-4efb-83ca-0ecd96725e4b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:42.551786 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-55b4c84f-bff9-4efb-83ca-0ecd96725e4b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:42.552224 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-55b4c84f-bff9-4efb-83ca-0ecd96725e4b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:42.633902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.objects.instance [None req-55b4c84f-bff9-4efb-83ca-0ecd96725e4b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lazy-loading 'services' on Instance uuid eab08501-7006-4b72-a3fa-caaec63f9b9b {{(pid=124381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 18:07:42.705639 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-55b4c84f-bff9-4efb-83ca-0ecd96725e4b tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "DELETE /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b/os-volume_attachments/9588eeac-c7a4-43b1-99b4-5b1e3c03e205" status: 202 len: 0 microversion: 2.1 time: 0.166265 Jul 21 18:07:42.706345 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 738/1462] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 18:07:42 2022] DELETE /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b/os-volume_attachments/9588eeac-c7a4-43b1-99b4-5b1e3c03e205 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:07:42.771365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1303cf5e-9eb3-46d8-8943-a898985d5d37 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:42.771986 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1303cf5e-9eb3-46d8-8943-a898985d5d37 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:42.777931 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1303cf5e-9eb3-46d8-8943-a898985d5d37 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:42.778390 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1303cf5e-9eb3-46d8-8943-a898985d5d37 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:42.779166 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1303cf5e-9eb3-46d8-8943-a898985d5d37 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:42.779608 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1303cf5e-9eb3-46d8-8943-a898985d5d37 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:42.794725 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:42.955626 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1303cf5e-9eb3-46d8-8943-a898985d5d37 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:42.967929 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1303cf5e-9eb3-46d8-8943-a898985d5d37 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:42.969508 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1303cf5e-9eb3-46d8-8943-a898985d5d37 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:42.970682 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1303cf5e-9eb3-46d8-8943-a898985d5d37 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.203801 Jul 21 18:07:42.971244 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 725/1463] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:42 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:43.455628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e77564d7-0a7a-420c-9760-140d48634e72 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:43.456358 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e77564d7-0a7a-420c-9760-140d48634e72 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:43.464076 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e77564d7-0a7a-420c-9760-140d48634e72 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:43.464560 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e77564d7-0a7a-420c-9760-140d48634e72 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:43.465576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e77564d7-0a7a-420c-9760-140d48634e72 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:43.466174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e77564d7-0a7a-420c-9760-140d48634e72 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-e77564d7-0a7a-420c-9760-140d48634e72 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] HTTP exception thrown: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e77564d7-0a7a-420c-9760-140d48634e72 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Request method failure captured: Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 HTTP/1.1 Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Y4U-MsSn6bgNds6M968BXjsUFVBgBj51xv4nUtIMqgKDDmu8nOsEICBMzE8JPLipfQVqRCQFoCQUuFxBkjWgYn3JJ1imQGeM1FIi00QRAJYPEC2AoLi3bVGPeaL_ZtQo8HRBX4VBJnLIq9HjyBZHzCFRqIUTymGPCAbnwesZVDvg-4 Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 5161720524a4488aa42e383597d30144 Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:07:43.506413 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:07:43.513030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5161720524a4488aa42e383597d30144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5161720524a4488aa42e383597d30144"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5161720524a4488aa42e383597d30144", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5161720524a4488aa42e383597d30144"}]}] Jul 21 18:07:43.513030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:07:43.513030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 5161720524a4488aa42e383597d30144 Jul 21 18:07:43.513030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:07:43.513030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-AttachVolumeTestJSON-290364262-project Jul 21 18:07:43.513030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:07:43.513030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:07:43.513030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 2ea3ea36439143b8a55f181170efc14a Jul 21 18:07:43.513030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-AttachVolumeTestJSON-290364262-project Jul 21 18:07:43.513030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:07:43.513030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:43.513030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': 'f826a69d-58cb-4b71-9282-0678122b31d8'} Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:07:43.513951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:43.516997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:07:43.521868 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e77564d7-0a7a-420c-9760-140d48634e72 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Returning 404 to user: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:07:43.521868 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e77564d7-0a7a-420c-9760-140d48634e72 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 404 len: 111 microversion: 2.1 time: 0.055147 Jul 21 18:07:43.521868 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 739/1464] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:43 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:07:43.522368 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-760abbe8-93cc-49dd-b32d-8231e425d385 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '.version_select at 0x7ffa2ed341f0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:43.557241 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-760abbe8-93cc-49dd-b32d-8231e425d385 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-28511971" status: 202 len: 0 microversion: 2.1 time: 0.044865 Jul 21 18:07:43.562129 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 726/1465] 10.222.0.57 () {58 vars in 1214 bytes} [Thu Jul 21 18:07:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-28511971 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 18:07:43.990449 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-97e94b5c-9625-4152-bd06-2c5073aabbcb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:43.991445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-97e94b5c-9625-4152-bd06-2c5073aabbcb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:44.000147 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-97e94b5c-9625-4152-bd06-2c5073aabbcb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:44.001023 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-97e94b5c-9625-4152-bd06-2c5073aabbcb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:44.002254 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-97e94b5c-9625-4152-bd06-2c5073aabbcb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:44.002769 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-97e94b5c-9625-4152-bd06-2c5073aabbcb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:44.217569 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-97e94b5c-9625-4152-bd06-2c5073aabbcb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:44.227728 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-97e94b5c-9625-4152-bd06-2c5073aabbcb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:44.229867 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-97e94b5c-9625-4152-bd06-2c5073aabbcb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:44.231822 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-97e94b5c-9625-4152-bd06-2c5073aabbcb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.245924 Jul 21 18:07:44.232695 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 740/1466] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:43 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 18:07:45.251278 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f1e4381e-74d1-4cf1-9e3c-e1d2f0423abf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:45.251888 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f1e4381e-74d1-4cf1-9e3c-e1d2f0423abf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:45.259780 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f1e4381e-74d1-4cf1-9e3c-e1d2f0423abf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:45.260236 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f1e4381e-74d1-4cf1-9e3c-e1d2f0423abf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:45.261128 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f1e4381e-74d1-4cf1-9e3c-e1d2f0423abf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:45.261573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f1e4381e-74d1-4cf1-9e3c-e1d2f0423abf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:45.402861 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f1e4381e-74d1-4cf1-9e3c-e1d2f0423abf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:45.412155 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f1e4381e-74d1-4cf1-9e3c-e1d2f0423abf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:45.413706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f1e4381e-74d1-4cf1-9e3c-e1d2f0423abf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:45.414992 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f1e4381e-74d1-4cf1-9e3c-e1d2f0423abf tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.167845 Jul 21 18:07:45.416107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 727/1467] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:45 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:46.436347 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b865d8eb-d2b5-4880-a0b0-32cda7d462ea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:46.437925 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b865d8eb-d2b5-4880-a0b0-32cda7d462ea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:46.447109 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b865d8eb-d2b5-4880-a0b0-32cda7d462ea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:46.448036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b865d8eb-d2b5-4880-a0b0-32cda7d462ea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:46.449281 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b865d8eb-d2b5-4880-a0b0-32cda7d462ea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:46.450013 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b865d8eb-d2b5-4880-a0b0-32cda7d462ea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:46.599729 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b865d8eb-d2b5-4880-a0b0-32cda7d462ea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:46.607772 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b865d8eb-d2b5-4880-a0b0-32cda7d462ea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:46.609297 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b865d8eb-d2b5-4880-a0b0-32cda7d462ea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:46.610447 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b865d8eb-d2b5-4880-a0b0-32cda7d462ea tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.179084 Jul 21 18:07:46.610994 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 741/1468] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:46 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:46.905279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6cac33f4-bdb3-4b26-9c52-8a09ea9dd2e8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:46.905942 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6cac33f4-bdb3-4b26-9c52-8a09ea9dd2e8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:46.918109 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6cac33f4-bdb3-4b26-9c52-8a09ea9dd2e8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:46.918952 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6cac33f4-bdb3-4b26-9c52-8a09ea9dd2e8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:46.920156 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6cac33f4-bdb3-4b26-9c52-8a09ea9dd2e8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:46.920708 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6cac33f4-bdb3-4b26-9c52-8a09ea9dd2e8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:46.938121 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-6cac33f4-bdb3-4b26-9c52-8a09ea9dd2e8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] HTTP exception thrown: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6cac33f4-bdb3-4b26-9c52-8a09ea9dd2e8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Request method failure captured: Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 HTTP/1.1 Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y4U-MsSn6bgNds6M968BXjsUFVBgBj51xv4nUtIMqgKDDmu8nOsEICBMzE8JPLipfQVqRCQFoCQUuFxBkjWgYn3JJ1imQGeM1FIi00QRAJYPEC2AoLi3bVGPeaL_ZtQo8HRBX4VBJnLIq9HjyBZHzCFRqIUTymGPCAbnwesZVDvg-4 Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 5161720524a4488aa42e383597d30144 Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:07:46.940136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:07:46.942154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5161720524a4488aa42e383597d30144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5161720524a4488aa42e383597d30144"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5161720524a4488aa42e383597d30144", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5161720524a4488aa42e383597d30144"}]}] Jul 21 18:07:46.942154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:07:46.942154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 5161720524a4488aa42e383597d30144 Jul 21 18:07:46.942154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:07:46.942154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeTestJSON-290364262-project Jul 21 18:07:46.942154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:07:46.942154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:07:46.942154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: 2ea3ea36439143b8a55f181170efc14a Jul 21 18:07:46.942154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeTestJSON-290364262-project Jul 21 18:07:46.942154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:07:46.942154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:46.942154 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': 'f826a69d-58cb-4b71-9282-0678122b31d8'} Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:07:46.943325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:46.945173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:07:46.947001 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6cac33f4-bdb3-4b26-9c52-8a09ea9dd2e8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Returning 404 to user: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:07:46.947001 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6cac33f4-bdb3-4b26-9c52-8a09ea9dd2e8 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 404 len: 111 microversion: 2.1 time: 0.040279 Jul 21 18:07:46.947001 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 728/1469] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:07:46 2022] DELETE /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:07:46.950400 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ec44ec5f-5fd3-4012-8c6d-1ff9ca5d7978 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:46.951685 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ec44ec5f-5fd3-4012-8c6d-1ff9ca5d7978 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: f826a69d-58cb-4b71-9282-0678122b31d8] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:46.958119 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ec44ec5f-5fd3-4012-8c6d-1ff9ca5d7978 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:46.958580 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ec44ec5f-5fd3-4012-8c6d-1ff9ca5d7978 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:46.959367 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ec44ec5f-5fd3-4012-8c6d-1ff9ca5d7978 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:46.959818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ec44ec5f-5fd3-4012-8c6d-1ff9ca5d7978 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:46.974252 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-ec44ec5f-5fd3-4012-8c6d-1ff9ca5d7978 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] HTTP exception thrown: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ec44ec5f-5fd3-4012-8c6d-1ff9ca5d7978 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Request method failure captured: Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 HTTP/1.1 Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Y4U-MsSn6bgNds6M968BXjsUFVBgBj51xv4nUtIMqgKDDmu8nOsEICBMzE8JPLipfQVqRCQFoCQUuFxBkjWgYn3JJ1imQGeM1FIi00QRAJYPEC2AoLi3bVGPeaL_ZtQo8HRBX4VBJnLIq9HjyBZHzCFRqIUTymGPCAbnwesZVDvg-4 Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 5161720524a4488aa42e383597d30144 Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:07:46.975798 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:07:46.977474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5161720524a4488aa42e383597d30144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5161720524a4488aa42e383597d30144"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5161720524a4488aa42e383597d30144", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5161720524a4488aa42e383597d30144"}]}] Jul 21 18:07:46.977474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:07:46.977474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 5161720524a4488aa42e383597d30144 Jul 21 18:07:46.977474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:07:46.977474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-AttachVolumeTestJSON-290364262-project Jul 21 18:07:46.977474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:07:46.977474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:07:46.977474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 2ea3ea36439143b8a55f181170efc14a Jul 21 18:07:46.977474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-AttachVolumeTestJSON-290364262-project Jul 21 18:07:46.977474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:07:46.977474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:46.977474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': 'f826a69d-58cb-4b71-9282-0678122b31d8'} Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:07:46.978509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. Jul 21 18:07:46.980168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:07:46.981807 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ec44ec5f-5fd3-4012-8c6d-1ff9ca5d7978 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Returning 404 to user: Instance f826a69d-58cb-4b71-9282-0678122b31d8 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:07:46.981807 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ec44ec5f-5fd3-4012-8c6d-1ff9ca5d7978 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8" status: 404 len: 111 microversion: 2.1 time: 0.030686 Jul 21 18:07:46.981807 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 742/1470] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:46 2022] GET /compute/v2.1/servers/f826a69d-58cb-4b71-9282-0678122b31d8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:07:47.630764 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f9e21426-5fa5-4141-ab34-cc047236f6e0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:47.631386 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f9e21426-5fa5-4141-ab34-cc047236f6e0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:47.637734 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9e21426-5fa5-4141-ab34-cc047236f6e0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:47.638185 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9e21426-5fa5-4141-ab34-cc047236f6e0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:47.638964 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9e21426-5fa5-4141-ab34-cc047236f6e0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:47.639436 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9e21426-5fa5-4141-ab34-cc047236f6e0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:47.791579 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f9e21426-5fa5-4141-ab34-cc047236f6e0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:47.805098 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f9e21426-5fa5-4141-ab34-cc047236f6e0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:47.807325 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f9e21426-5fa5-4141-ab34-cc047236f6e0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:47.809203 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f9e21426-5fa5-4141-ab34-cc047236f6e0 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.183448 Jul 21 18:07:47.810140 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 729/1471] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:47 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:48.829140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f172b923-1ad3-4d01-a3c6-61e3459725be tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:48.830843 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f172b923-1ad3-4d01-a3c6-61e3459725be tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:48.849415 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f172b923-1ad3-4d01-a3c6-61e3459725be tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:48.850168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f172b923-1ad3-4d01-a3c6-61e3459725be tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:48.851139 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f172b923-1ad3-4d01-a3c6-61e3459725be tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:48.851583 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f172b923-1ad3-4d01-a3c6-61e3459725be tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:49.001943 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f172b923-1ad3-4d01-a3c6-61e3459725be tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:49.012221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f172b923-1ad3-4d01-a3c6-61e3459725be tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:49.014201 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f172b923-1ad3-4d01-a3c6-61e3459725be tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:49.015692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f172b923-1ad3-4d01-a3c6-61e3459725be tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.191839 Jul 21 18:07:49.016362 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 743/1472] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:48 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:50.037022 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cf697210-c899-4e1a-95f1-da08a03fec19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:50.038336 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cf697210-c899-4e1a-95f1-da08a03fec19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:50.049365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf697210-c899-4e1a-95f1-da08a03fec19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:50.050191 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf697210-c899-4e1a-95f1-da08a03fec19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:50.051884 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf697210-c899-4e1a-95f1-da08a03fec19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:50.052631 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf697210-c899-4e1a-95f1-da08a03fec19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:50.198511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cf697210-c899-4e1a-95f1-da08a03fec19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:50.208235 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cf697210-c899-4e1a-95f1-da08a03fec19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:50.209879 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cf697210-c899-4e1a-95f1-da08a03fec19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:50.211444 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cf697210-c899-4e1a-95f1-da08a03fec19 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.180027 Jul 21 18:07:50.223559 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 730/1473] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:50 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:51.231043 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-361f06b6-8917-469b-8f84-3fd48f7539bd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:51.231645 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-361f06b6-8917-469b-8f84-3fd48f7539bd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:51.238339 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-361f06b6-8917-469b-8f84-3fd48f7539bd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:51.239971 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-361f06b6-8917-469b-8f84-3fd48f7539bd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:51.240797 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-361f06b6-8917-469b-8f84-3fd48f7539bd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:51.241239 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-361f06b6-8917-469b-8f84-3fd48f7539bd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:51.246673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:07:51.419998 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-361f06b6-8917-469b-8f84-3fd48f7539bd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:51.428730 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-361f06b6-8917-469b-8f84-3fd48f7539bd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:51.430213 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-361f06b6-8917-469b-8f84-3fd48f7539bd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:51.431457 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-361f06b6-8917-469b-8f84-3fd48f7539bd tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.204490 Jul 21 18:07:51.432016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 744/1474] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:51 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 18:07:52.456818 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-da28d45a-87ad-46ac-918c-de944bf2325a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:52.457749 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-da28d45a-87ad-46ac-918c-de944bf2325a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:52.463845 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da28d45a-87ad-46ac-918c-de944bf2325a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:52.464306 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da28d45a-87ad-46ac-918c-de944bf2325a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:52.465073 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da28d45a-87ad-46ac-918c-de944bf2325a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:52.465507 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-da28d45a-87ad-46ac-918c-de944bf2325a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:52.593152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-da28d45a-87ad-46ac-918c-de944bf2325a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:52.602731 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-da28d45a-87ad-46ac-918c-de944bf2325a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:52.604447 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-da28d45a-87ad-46ac-918c-de944bf2325a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:52.605620 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-da28d45a-87ad-46ac-918c-de944bf2325a tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.152638 Jul 21 18:07:52.606177 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 731/1475] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:52 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:53.624252 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-747a32ea-0165-426f-ad1e-7cac7fc4b093 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:53.624899 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-747a32ea-0165-426f-ad1e-7cac7fc4b093 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:53.632668 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-747a32ea-0165-426f-ad1e-7cac7fc4b093 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:53.633120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-747a32ea-0165-426f-ad1e-7cac7fc4b093 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:53.633890 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-747a32ea-0165-426f-ad1e-7cac7fc4b093 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:53.634319 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-747a32ea-0165-426f-ad1e-7cac7fc4b093 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:53.774587 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-747a32ea-0165-426f-ad1e-7cac7fc4b093 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:53.782688 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-747a32ea-0165-426f-ad1e-7cac7fc4b093 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:53.784228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-747a32ea-0165-426f-ad1e-7cac7fc4b093 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:53.785459 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-747a32ea-0165-426f-ad1e-7cac7fc4b093 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.165196 Jul 21 18:07:53.786036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 745/1476] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:53 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:54.494040 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9c074dc7-4dbe-4957-af5c-4e6e26c57b97 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:54.494560 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9c074dc7-4dbe-4957-af5c-4e6e26c57b97 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:54.501115 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c074dc7-4dbe-4957-af5c-4e6e26c57b97 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:54.501600 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c074dc7-4dbe-4957-af5c-4e6e26c57b97 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:54.502320 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c074dc7-4dbe-4957-af5c-4e6e26c57b97 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:54.502753 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c074dc7-4dbe-4957-af5c-4e6e26c57b97 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:54.528710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9c074dc7-4dbe-4957-af5c-4e6e26c57b97 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 18:07:54.608355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9c074dc7-4dbe-4957-af5c-4e6e26c57b97 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "DELETE /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 204 len: 0 microversion: 2.1 time: 0.117551 Jul 21 18:07:54.609060 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 732/1477] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:07:54 2022] DELETE /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 18:07:54.617374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9813005a-ebad-4791-954b-04028f04369f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:54.618039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9813005a-ebad-4791-954b-04028f04369f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:54.624051 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9813005a-ebad-4791-954b-04028f04369f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:54.624591 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9813005a-ebad-4791-954b-04028f04369f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:54.625357 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9813005a-ebad-4791-954b-04028f04369f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:54.625793 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9813005a-ebad-4791-954b-04028f04369f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:54.757740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9813005a-ebad-4791-954b-04028f04369f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:54.765143 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9813005a-ebad-4791-954b-04028f04369f tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1514 microversion: 2.1 time: 0.151915 Jul 21 18:07:54.765706 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 746/1478] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:54 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:54.803980 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4ff862e6-b612-4316-9b2f-adaf1037e29b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:54.804818 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4ff862e6-b612-4316-9b2f-adaf1037e29b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:54.810998 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ff862e6-b612-4316-9b2f-adaf1037e29b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:54.811457 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ff862e6-b612-4316-9b2f-adaf1037e29b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:54.812230 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ff862e6-b612-4316-9b2f-adaf1037e29b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:54.812699 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ff862e6-b612-4316-9b2f-adaf1037e29b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:54.949483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4ff862e6-b612-4316-9b2f-adaf1037e29b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:54.957494 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4ff862e6-b612-4316-9b2f-adaf1037e29b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:54.959975 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4ff862e6-b612-4316-9b2f-adaf1037e29b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:54.961176 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4ff862e6-b612-4316-9b2f-adaf1037e29b tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.162042 Jul 21 18:07:54.961747 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 733/1479] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:54 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:55.782298 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e257374f-837a-43f9-9149-7256c64043f4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:55.782933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e257374f-837a-43f9-9149-7256c64043f4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:55.790212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e257374f-837a-43f9-9149-7256c64043f4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:55.790665 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e257374f-837a-43f9-9149-7256c64043f4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:55.791428 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e257374f-837a-43f9-9149-7256c64043f4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:55.791862 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e257374f-837a-43f9-9149-7256c64043f4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:55.921859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e257374f-837a-43f9-9149-7256c64043f4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:55.930389 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e257374f-837a-43f9-9149-7256c64043f4 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1514 microversion: 2.1 time: 0.151811 Jul 21 18:07:55.930961 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 747/1480] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:55 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:07:55.979759 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2d998172-aed0-478e-8e29-bbeb66a4aa8e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:55.980407 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2d998172-aed0-478e-8e29-bbeb66a4aa8e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:55.987250 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d998172-aed0-478e-8e29-bbeb66a4aa8e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:55.987707 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d998172-aed0-478e-8e29-bbeb66a4aa8e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:55.988525 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d998172-aed0-478e-8e29-bbeb66a4aa8e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:55.988971 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d998172-aed0-478e-8e29-bbeb66a4aa8e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:56.125302 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2d998172-aed0-478e-8e29-bbeb66a4aa8e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:56.133957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2d998172-aed0-478e-8e29-bbeb66a4aa8e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:56.135464 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2d998172-aed0-478e-8e29-bbeb66a4aa8e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:56.136716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2d998172-aed0-478e-8e29-bbeb66a4aa8e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.160843 Jul 21 18:07:56.137531 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 734/1481] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:55 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:56.773961 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-4c9901cd-5fd5-4497-9dd4-773f1a1e9e8f req-cf5331ab-e6e5-40b2-8261-d96230a1581a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab08501-7006-4b72-a3fa-caaec63f9b9b", "name": "network-vif-deleted", "tag": "dd3b6974-16c9-4b8e-991d-b6f68658f030"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:56.784059 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-4c9901cd-5fd5-4497-9dd4-773f1a1e9e8f req-cf5331ab-e6e5-40b2-8261-d96230a1581a service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:56.785584 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-4c9901cd-5fd5-4497-9dd4-773f1a1e9e8f req-cf5331ab-e6e5-40b2-8261-d96230a1581a service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:56.801415 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-4c9901cd-5fd5-4497-9dd4-773f1a1e9e8f req-cf5331ab-e6e5-40b2-8261-d96230a1581a service nova] Creating event network-vif-deleted:dd3b6974-16c9-4b8e-991d-b6f68658f030 for instance eab08501-7006-4b72-a3fa-caaec63f9b9b on hv-cinder-82549 Jul 21 18:07:56.806265 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-4c9901cd-5fd5-4497-9dd4-773f1a1e9e8f req-cf5331ab-e6e5-40b2-8261-d96230a1581a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038321 Jul 21 18:07:56.806928 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 748/1482] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:07:56.947395 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-935ab3e4-501b-4a07-aa70-4afaf310bc1c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:56.948051 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-935ab3e4-501b-4a07-aa70-4afaf310bc1c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:56.954765 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-935ab3e4-501b-4a07-aa70-4afaf310bc1c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:56.955223 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-935ab3e4-501b-4a07-aa70-4afaf310bc1c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:56.955996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-935ab3e4-501b-4a07-aa70-4afaf310bc1c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:56.956479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-935ab3e4-501b-4a07-aa70-4afaf310bc1c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:56.988511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-935ab3e4-501b-4a07-aa70-4afaf310bc1c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:56.989179 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-935ab3e4-501b-4a07-aa70-4afaf310bc1c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:56.989416 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-935ab3e4-501b-4a07-aa70-4afaf310bc1c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lazy-loading 'fault' on Instance uuid eab08501-7006-4b72-a3fa-caaec63f9b9b {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 18:07:57.035015 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-935ab3e4-501b-4a07-aa70-4afaf310bc1c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4cfa3ccdab43c3adafcef62e62365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47e6891d6044e2caf067cad4309c57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:57.043155 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-935ab3e4-501b-4a07-aa70-4afaf310bc1c tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 200 len: 1309 microversion: 2.1 time: 0.099587 Jul 21 18:07:57.043711 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 735/1483] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:56 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:07:57.156808 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ef8a2405-90cc-4be7-9a91-50e8e95764d4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:57.157527 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ef8a2405-90cc-4be7-9a91-50e8e95764d4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:57.163722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ef8a2405-90cc-4be7-9a91-50e8e95764d4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:57.164170 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ef8a2405-90cc-4be7-9a91-50e8e95764d4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:57.164950 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ef8a2405-90cc-4be7-9a91-50e8e95764d4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:57.165382 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ef8a2405-90cc-4be7-9a91-50e8e95764d4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:57.301318 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ef8a2405-90cc-4be7-9a91-50e8e95764d4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:57.309869 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ef8a2405-90cc-4be7-9a91-50e8e95764d4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:57.311455 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ef8a2405-90cc-4be7-9a91-50e8e95764d4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:57.312701 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ef8a2405-90cc-4be7-9a91-50e8e95764d4 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.161320 Jul 21 18:07:57.313360 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 749/1484] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:57 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:58.060208 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ac67fb3a-bc5a-4d6e-ab3c-bba8bed2e994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:58.060854 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ac67fb3a-bc5a-4d6e-ab3c-bba8bed2e994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] [instance: eab08501-7006-4b72-a3fa-caaec63f9b9b] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:58.067352 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac67fb3a-bc5a-4d6e-ab3c-bba8bed2e994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:58.067805 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac67fb3a-bc5a-4d6e-ab3c-bba8bed2e994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:58.069345 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac67fb3a-bc5a-4d6e-ab3c-bba8bed2e994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:58.069792 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ac67fb3a-bc5a-4d6e-ab3c-bba8bed2e994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:58.082922 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-ac67fb3a-bc5a-4d6e-ab3c-bba8bed2e994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] HTTP exception thrown: Instance eab08501-7006-4b72-a3fa-caaec63f9b9b could not be found. Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ac67fb3a-bc5a-4d6e-ab3c-bba8bed2e994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Request method failure captured: Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b HTTP/1.1 Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y49yoeFd83VFO7VF6Nfcbm0rDA5ybVhP3CTykjfep7CcIhCnutJEDMz2b_DbrAF6kIe5H0JsyiCldZCOjQsQQN_i9g0Vupbk-416796Bdq1TQERFFrWbZL0FMRzAtqSZgGTqQzklPWwH30LAsKHpy5ePSW_-9oX47tqW17DPA-6Fjg Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: e47e6891d6044e2caf067cad4309c57f Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1946468759 Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:07:58.085025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:07:58.086762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e47e6891d6044e2caf067cad4309c57f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e47e6891d6044e2caf067cad4309c57f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e47e6891d6044e2caf067cad4309c57f", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e47e6891d6044e2caf067cad4309c57f"}]}] Jul 21 18:07:58.086762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesSnapshotTestJSON-1946468759 Jul 21 18:07:58.086762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: e47e6891d6044e2caf067cad4309c57f Jul 21 18:07:58.086762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1946468759 Jul 21 18:07:58.086762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesSnapshotTestJSON-1946468759-project Jul 21 18:07:58.086762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:07:58.086762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:07:58.086762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: ac4cfa3ccdab43c3adafcef62e62365f Jul 21 18:07:58.086762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesSnapshotTestJSON-1946468759-project Jul 21 18:07:58.086762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:07:58.086762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance eab08501-7006-4b72-a3fa-caaec63f9b9b could not be found. Jul 21 18:07:58.086762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': 'eab08501-7006-4b72-a3fa-caaec63f9b9b'} Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eab08501-7006-4b72-a3fa-caaec63f9b9b could not be found. Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:07:58.087933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eab08501-7006-4b72-a3fa-caaec63f9b9b could not be found. Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eab08501-7006-4b72-a3fa-caaec63f9b9b could not be found. Jul 21 18:07:58.089540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:07:58.090982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ac67fb3a-bc5a-4d6e-ab3c-bba8bed2e994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] Returning 404 to user: Instance eab08501-7006-4b72-a3fa-caaec63f9b9b could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:07:58.090982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ac67fb3a-bc5a-4d6e-ab3c-bba8bed2e994 tempest-VolumesSnapshotTestJSON-1946468759 tempest-VolumesSnapshotTestJSON-1946468759-project] 10.222.0.57 "GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b" status: 404 len: 111 microversion: 2.1 time: 0.030126 Jul 21 18:07:58.090982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 736/1485] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:07:58 2022] GET /compute/v2.1/servers/eab08501-7006-4b72-a3fa-caaec63f9b9b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:07:58.332407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-93514515-3f0b-46a7-8c83-8320e6ff34fb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:58.333088 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-93514515-3f0b-46a7-8c83-8320e6ff34fb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:58.340160 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-5b2ea3b5-eb59-42ee-a713-6b951a060b6c req-6ec1c0f4-ee5e-4717-a4b7-06ae27a87683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f527049-c7ec-49e6-91e1-117b50b70c43", "name": "network-vif-plugged", "status": "completed", "tag": "185dcd5b-b337-4222-acff-146ba91a9e43"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:07:58.353484 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-5b2ea3b5-eb59-42ee-a713-6b951a060b6c req-6ec1c0f4-ee5e-4717-a4b7-06ae27a87683 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:58.353812 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93514515-3f0b-46a7-8c83-8320e6ff34fb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:58.354085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-5b2ea3b5-eb59-42ee-a713-6b951a060b6c req-6ec1c0f4-ee5e-4717-a4b7-06ae27a87683 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:58.354418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93514515-3f0b-46a7-8c83-8320e6ff34fb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:58.355435 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93514515-3f0b-46a7-8c83-8320e6ff34fb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:58.355958 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93514515-3f0b-46a7-8c83-8320e6ff34fb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:58.368932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-5b2ea3b5-eb59-42ee-a713-6b951a060b6c req-6ec1c0f4-ee5e-4717-a4b7-06ae27a87683 service nova] Creating event network-vif-plugged:185dcd5b-b337-4222-acff-146ba91a9e43 for instance 0f527049-c7ec-49e6-91e1-117b50b70c43 on hv-cinder-82549 Jul 21 18:07:58.374991 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-5b2ea3b5-eb59-42ee-a713-6b951a060b6c req-6ec1c0f4-ee5e-4717-a4b7-06ae27a87683 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038836 Jul 21 18:07:58.376023 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 737/1486] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:07:58.502754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-93514515-3f0b-46a7-8c83-8320e6ff34fb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:58.511079 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-93514515-3f0b-46a7-8c83-8320e6ff34fb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:58.512627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-93514515-3f0b-46a7-8c83-8320e6ff34fb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:58.513784 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-93514515-3f0b-46a7-8c83-8320e6ff34fb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.185520 Jul 21 18:07:58.514339 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 750/1487] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:58 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:07:59.533540 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ddf26cce-b801-47d4-928e-7cb222f6c305 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:07:59.534240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ddf26cce-b801-47d4-928e-7cb222f6c305 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:07:59.541105 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddf26cce-b801-47d4-928e-7cb222f6c305 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:59.541517 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddf26cce-b801-47d4-928e-7cb222f6c305 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:59.542417 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddf26cce-b801-47d4-928e-7cb222f6c305 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:07:59.542853 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddf26cce-b801-47d4-928e-7cb222f6c305 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:07:59.683188 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ddf26cce-b801-47d4-928e-7cb222f6c305 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:59.692380 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ddf26cce-b801-47d4-928e-7cb222f6c305 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:59.693924 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ddf26cce-b801-47d4-928e-7cb222f6c305 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:07:59.695088 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ddf26cce-b801-47d4-928e-7cb222f6c305 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.166228 Jul 21 18:07:59.695641 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 738/1488] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:07:59 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:08:00.714049 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b672d607-b151-4933-a64c-fa4974036f09 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:00.714666 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b672d607-b151-4933-a64c-fa4974036f09 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:00.721143 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b672d607-b151-4933-a64c-fa4974036f09 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:00.721600 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b672d607-b151-4933-a64c-fa4974036f09 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:00.722363 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b672d607-b151-4933-a64c-fa4974036f09 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:00.722806 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b672d607-b151-4933-a64c-fa4974036f09 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:00.852283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b672d607-b151-4933-a64c-fa4974036f09 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:00.861229 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b672d607-b151-4933-a64c-fa4974036f09 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:00.862748 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b672d607-b151-4933-a64c-fa4974036f09 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:00.863908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b672d607-b151-4933-a64c-fa4974036f09 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.154381 Jul 21 18:08:00.864484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 751/1489] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:08:00 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:08:01.881882 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-75c5146a-ffa5-4a84-b34c-30d06d8b7646 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:01.882913 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-75c5146a-ffa5-4a84-b34c-30d06d8b7646 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:01.889179 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75c5146a-ffa5-4a84-b34c-30d06d8b7646 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:01.889627 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75c5146a-ffa5-4a84-b34c-30d06d8b7646 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:01.890397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75c5146a-ffa5-4a84-b34c-30d06d8b7646 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:01.890833 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-75c5146a-ffa5-4a84-b34c-30d06d8b7646 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:02.022286 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-75c5146a-ffa5-4a84-b34c-30d06d8b7646 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:02.030683 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-75c5146a-ffa5-4a84-b34c-30d06d8b7646 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:02.032168 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-75c5146a-ffa5-4a84-b34c-30d06d8b7646 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:02.033391 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-75c5146a-ffa5-4a84-b34c-30d06d8b7646 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.155445 Jul 21 18:08:02.033896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 739/1490] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:08:01 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:08:03.051801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c563df6f-4001-40f1-9172-10919292e968 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:03.052967 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c563df6f-4001-40f1-9172-10919292e968 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:03.060488 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c563df6f-4001-40f1-9172-10919292e968 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:03.060943 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c563df6f-4001-40f1-9172-10919292e968 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:03.061923 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c563df6f-4001-40f1-9172-10919292e968 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:03.062364 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c563df6f-4001-40f1-9172-10919292e968 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:03.203682 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c563df6f-4001-40f1-9172-10919292e968 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:03.211796 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c563df6f-4001-40f1-9172-10919292e968 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:03.213343 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c563df6f-4001-40f1-9172-10919292e968 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:03.214509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c563df6f-4001-40f1-9172-10919292e968 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1730 microversion: 2.20 time: 0.166755 Jul 21 18:08:03.215072 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 752/1491] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:08:03 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:08:04.231849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-11e7662b-cd84-4216-99ad-6c7d8c22ed10 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:04.232488 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-11e7662b-cd84-4216-99ad-6c7d8c22ed10 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:04.238889 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11e7662b-cd84-4216-99ad-6c7d8c22ed10 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:04.239329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11e7662b-cd84-4216-99ad-6c7d8c22ed10 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:04.240086 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11e7662b-cd84-4216-99ad-6c7d8c22ed10 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:04.240545 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11e7662b-cd84-4216-99ad-6c7d8c22ed10 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:04.373757 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11e7662b-cd84-4216-99ad-6c7d8c22ed10 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:04.381630 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11e7662b-cd84-4216-99ad-6c7d8c22ed10 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:04.383797 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11e7662b-cd84-4216-99ad-6c7d8c22ed10 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:04.384956 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-11e7662b-cd84-4216-99ad-6c7d8c22ed10 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1717 microversion: 2.20 time: 0.157040 Jul 21 18:08:04.385507 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 740/1492] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:08:04 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:08:34.219528 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b69b423d-82eb-4a3f-b573-21275dfed29f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:34.220557 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b69b423d-82eb-4a3f-b573-21275dfed29f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:34.223004 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:08:34.236885 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=48 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:08:34.243603 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b69b423d-82eb-4a3f-b573-21275dfed29f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:34.244125 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b69b423d-82eb-4a3f-b573-21275dfed29f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:34.244947 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b69b423d-82eb-4a3f-b573-21275dfed29f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:34.245387 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b69b423d-82eb-4a3f-b573-21275dfed29f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:34.289961 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b69b423d-82eb-4a3f-b573-21275dfed29f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.074372 Jul 21 18:08:34.306807 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 753/1493] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jul 21 18:08:34 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:08:34.364793 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-284d2fc8-ef34-4ecd-af4e-fab7288a91de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:34.366263 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-284d2fc8-ef34-4ecd-af4e-fab7288a91de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:34.372323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:08:34.373408 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:08:34.374969 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-284d2fc8-ef34-4ecd-af4e-fab7288a91de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:34.375507 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-284d2fc8-ef34-4ecd-af4e-fab7288a91de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:34.378852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-284d2fc8-ef34-4ecd-af4e-fab7288a91de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:34.379962 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-284d2fc8-ef34-4ecd-af4e-fab7288a91de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:34.418706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-284d2fc8-ef34-4ecd-af4e-fab7288a91de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 18:08:34.561816 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-284d2fc8-ef34-4ecd-af4e-fab7288a91de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 204 len: 0 microversion: 2.20 time: 0.201104 Jul 21 18:08:34.562406 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 741/1494] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jul 21 18:08:34 2022] DELETE /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 18:08:34.575068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d4949d8e-135d-4a9d-a6da-b6c78a887623 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:34.577565 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d4949d8e-135d-4a9d-a6da-b6c78a887623 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:34.594036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d4949d8e-135d-4a9d-a6da-b6c78a887623 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:34.594576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d4949d8e-135d-4a9d-a6da-b6c78a887623 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:34.595458 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d4949d8e-135d-4a9d-a6da-b6c78a887623 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:34.596761 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d4949d8e-135d-4a9d-a6da-b6c78a887623 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:34.819724 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d4949d8e-135d-4a9d-a6da-b6c78a887623 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:34.848087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d4949d8e-135d-4a9d-a6da-b6c78a887623 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:34.850330 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d4949d8e-135d-4a9d-a6da-b6c78a887623 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:34.853109 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d4949d8e-135d-4a9d-a6da-b6c78a887623 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1723 microversion: 2.20 time: 0.283627 Jul 21 18:08:34.866594 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 754/1495] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:08:34 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:08:35.874689 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ff08006f-a524-479b-8727-d61851097c2e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:35.875400 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ff08006f-a524-479b-8727-d61851097c2e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:35.888051 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff08006f-a524-479b-8727-d61851097c2e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:35.889608 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff08006f-a524-479b-8727-d61851097c2e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:35.892813 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff08006f-a524-479b-8727-d61851097c2e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:35.894113 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff08006f-a524-479b-8727-d61851097c2e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:36.304806 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ff08006f-a524-479b-8727-d61851097c2e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:36.313714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ff08006f-a524-479b-8727-d61851097c2e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:36.315560 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ff08006f-a524-479b-8727-d61851097c2e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:36.317005 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ff08006f-a524-479b-8727-d61851097c2e tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1723 microversion: 2.20 time: 0.446944 Jul 21 18:08:36.317954 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 742/1496] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:08:35 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1723 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:08:37.340529 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3f97e4ac-cf3c-4126-943c-7371dec36e63 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:37.342038 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3f97e4ac-cf3c-4126-943c-7371dec36e63 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:37.363162 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f97e4ac-cf3c-4126-943c-7371dec36e63 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:37.363663 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f97e4ac-cf3c-4126-943c-7371dec36e63 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:37.373469 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f97e4ac-cf3c-4126-943c-7371dec36e63 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:37.373930 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f97e4ac-cf3c-4126-943c-7371dec36e63 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:37.550902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3f97e4ac-cf3c-4126-943c-7371dec36e63 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:37.565264 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3f97e4ac-cf3c-4126-943c-7371dec36e63 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:37.566790 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3f97e4ac-cf3c-4126-943c-7371dec36e63 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd08a5eaa6d814e388b0af0581a530888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444abcf11d564f7692af245f2bd98a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:37.571633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3f97e4ac-cf3c-4126-943c-7371dec36e63 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 200 len: 1655 microversion: 2.20 time: 0.238972 Jul 21 18:08:37.575752 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 755/1497] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:08:37 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 1655 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 18:08:37.678041 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-1a9ce459-851c-48cc-b401-5d81236200df req-bc3d6252-8fb6-43d8-b306-22c7b617476b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f527049-c7ec-49e6-91e1-117b50b70c43", "name": "network-vif-deleted", "tag": "185dcd5b-b337-4222-acff-146ba91a9e43"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:08:37.692034 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-1a9ce459-851c-48cc-b401-5d81236200df req-bc3d6252-8fb6-43d8-b306-22c7b617476b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:37.693222 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-1a9ce459-851c-48cc-b401-5d81236200df req-bc3d6252-8fb6-43d8-b306-22c7b617476b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:37.729035 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-1a9ce459-851c-48cc-b401-5d81236200df req-bc3d6252-8fb6-43d8-b306-22c7b617476b service nova] Creating event network-vif-deleted:185dcd5b-b337-4222-acff-146ba91a9e43 for instance 0f527049-c7ec-49e6-91e1-117b50b70c43 on hv-cinder-82549 Jul 21 18:08:37.742178 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-1a9ce459-851c-48cc-b401-5d81236200df req-bc3d6252-8fb6-43d8-b306-22c7b617476b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075615 Jul 21 18:08:37.743489 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 743/1498] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:08:38.147634 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8c9f57cd-d6d9-4cf9-88cc-608fd9579373 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Action: 'create', calling method: .version_select at 0x7ffa2a58b9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1392459256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbL6QsbY7iaZJebSsWUT1Qqv8X89c4lyeETQkSBsWho+ogVYKReH91KCTSpsJOixsLalqiE++MYq83YdGm7gCjyWlv4d6RxBWir/n5oaxJApQLoixiSGXKr8oPPznC3cw=="}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:08:38.179082 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-8c9f57cd-d6d9-4cf9-88cc-608fd9579373 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Getting quotas for project 076a5b3e4cd141b9bd9ef199e0fa0ba1. Resources: {'key_pairs'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:08:38.185591 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-8c9f57cd-d6d9-4cf9-88cc-608fd9579373 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Getting quotas for user 293d4ca894e24e4fb6c4e7aa14256d78 and project 076a5b3e4cd141b9bd9ef199e0fa0ba1. Resources: {'key_pairs'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:08:38.232217 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8c9f57cd-d6d9-4cf9-88cc-608fd9579373 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.340248 Jul 21 18:08:38.232662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 756/1499] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 18:08:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:08:38.593625 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-aa32164d-0ff7-4375-b959-d13aead911ff tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:38.594330 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-aa32164d-0ff7-4375-b959-d13aead911ff tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:38.601242 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa32164d-0ff7-4375-b959-d13aead911ff tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:38.601788 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa32164d-0ff7-4375-b959-d13aead911ff tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:38.602570 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa32164d-0ff7-4375-b959-d13aead911ff tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:38.603067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa32164d-0ff7-4375-b959-d13aead911ff tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:38.619097 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-aa32164d-0ff7-4375-b959-d13aead911ff tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] HTTP exception thrown: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-aa32164d-0ff7-4375-b959-d13aead911ff tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Request method failure captured: Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 HTTP/1.1 Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2ZMHOxJgAvMbgMW0iaUKM89p8tyHINXCyN5GwXdmdLf4H_EXsTcwqakpWLNfBrMoQYY5Vq9J0jZNTE29giQQ4PbkTLiH49q0mVJp__vp3nGdUYTLD31aNGu8bRcZ0LFTOeoMvjwdug90r9Jn3l1n4tEXj_Bvy8Nz-Y5X7oMjE-xqz3U Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 444abcf11d564f7692af245f2bd98a84 Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:08:38.620812 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:08:38.622811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/444abcf11d564f7692af245f2bd98a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/444abcf11d564f7692af245f2bd98a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_444abcf11d564f7692af245f2bd98a84", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/444abcf11d564f7692af245f2bd98a84"}]}] Jul 21 18:08:38.622811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:38.622811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 444abcf11d564f7692af245f2bd98a84 Jul 21 18:08:38.622811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:38.622811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeShelveTestJSON-951849365-project Jul 21 18:08:38.622811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:08:38.622811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:08:38.622811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: d08a5eaa6d814e388b0af0581a530888 Jul 21 18:08:38.622811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeShelveTestJSON-951849365-project Jul 21 18:08:38.622811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:08:38.622811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:38.622811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '0f527049-c7ec-49e6-91e1-117b50b70c43'} Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:08:38.623883 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:38.626399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:38.629152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-aa32164d-0ff7-4375-b959-d13aead911ff tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Returning 404 to user: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:08:38.629152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-aa32164d-0ff7-4375-b959-d13aead911ff tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 404 len: 111 microversion: 2.20 time: 0.032869 Jul 21 18:08:38.629152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 744/1500] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:08:38 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 18:08:38.632281 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a0dde74a-8105-4cd6-b951-3ec013d098b5 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '.version_select at 0x7ffa2a8950d0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:38.653281 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a0dde74a-8105-4cd6-b951-3ec013d098b5 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869042420" status: 204 len: 0 microversion: 2.20 time: 0.025940 Jul 21 18:08:38.654777 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 757/1501] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jul 21 18:08:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869042420 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 18:08:40.833928 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4ab4272f-29ba-4778-8393-178fe2e016eb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:40.835008 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4ab4272f-29ba-4778-8393-178fe2e016eb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:40.842178 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ab4272f-29ba-4778-8393-178fe2e016eb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:40.843029 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ab4272f-29ba-4778-8393-178fe2e016eb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:40.844121 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ab4272f-29ba-4778-8393-178fe2e016eb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:40.844811 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ab4272f-29ba-4778-8393-178fe2e016eb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:40.863628 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-4ab4272f-29ba-4778-8393-178fe2e016eb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] HTTP exception thrown: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4ab4272f-29ba-4778-8393-178fe2e016eb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Request method failure captured: Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 HTTP/1.1 Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2ZMHOxJgAvMbgMW0iaUKM89p8tyHINXCyN5GwXdmdLf4H_EXsTcwqakpWLNfBrMoQYY5Vq9J0jZNTE29giQQ4PbkTLiH49q0mVJp__vp3nGdUYTLD31aNGu8bRcZ0LFTOeoMvjwdug90r9Jn3l1n4tEXj_Bvy8Nz-Y5X7oMjE-xqz3U Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 444abcf11d564f7692af245f2bd98a84 Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:08:40.871333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:08:40.873037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/444abcf11d564f7692af245f2bd98a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/444abcf11d564f7692af245f2bd98a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_444abcf11d564f7692af245f2bd98a84", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/444abcf11d564f7692af245f2bd98a84"}]}] Jul 21 18:08:40.873037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:40.873037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 444abcf11d564f7692af245f2bd98a84 Jul 21 18:08:40.873037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:40.873037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeShelveTestJSON-951849365-project Jul 21 18:08:40.873037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:08:40.873037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:08:40.873037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: d08a5eaa6d814e388b0af0581a530888 Jul 21 18:08:40.873037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeShelveTestJSON-951849365-project Jul 21 18:08:40.873037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:08:40.873037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:40.873037 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '0f527049-c7ec-49e6-91e1-117b50b70c43'} Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:08:40.873983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:40.875594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:40.878119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4ab4272f-29ba-4778-8393-178fe2e016eb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Returning 404 to user: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:08:40.879159 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4ab4272f-29ba-4778-8393-178fe2e016eb tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 404 len: 111 microversion: 2.20 time: 0.050116 Jul 21 18:08:40.879727 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 745/1502] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jul 21 18:08:40 2022] DELETE /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 18:08:40.889330 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bf96dc98-928e-4988-8b2b-284385f058a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:40.890646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bf96dc98-928e-4988-8b2b-284385f058a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 0f527049-c7ec-49e6-91e1-117b50b70c43] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:40.898944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bf96dc98-928e-4988-8b2b-284385f058a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:40.899396 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bf96dc98-928e-4988-8b2b-284385f058a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:40.900615 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bf96dc98-928e-4988-8b2b-284385f058a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:40.903775 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bf96dc98-928e-4988-8b2b-284385f058a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:40.924238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-bf96dc98-928e-4988-8b2b-284385f058a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] HTTP exception thrown: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bf96dc98-928e-4988-8b2b-284385f058a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Request method failure captured: Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 HTTP/1.1 Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2ZMHOxJgAvMbgMW0iaUKM89p8tyHINXCyN5GwXdmdLf4H_EXsTcwqakpWLNfBrMoQYY5Vq9J0jZNTE29giQQ4PbkTLiH49q0mVJp__vp3nGdUYTLD31aNGu8bRcZ0LFTOeoMvjwdug90r9Jn3l1n4tEXj_Bvy8Nz-Y5X7oMjE-xqz3U Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 444abcf11d564f7692af245f2bd98a84 Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:08:40.926863 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:08:40.928905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/444abcf11d564f7692af245f2bd98a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/444abcf11d564f7692af245f2bd98a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_444abcf11d564f7692af245f2bd98a84", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/444abcf11d564f7692af245f2bd98a84"}]}] Jul 21 18:08:40.928905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:40.928905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 444abcf11d564f7692af245f2bd98a84 Jul 21 18:08:40.928905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:40.928905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-AttachVolumeShelveTestJSON-951849365-project Jul 21 18:08:40.928905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:08:40.928905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:08:40.928905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: d08a5eaa6d814e388b0af0581a530888 Jul 21 18:08:40.928905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-AttachVolumeShelveTestJSON-951849365-project Jul 21 18:08:40.928905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:08:40.928905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:40.928905 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '0f527049-c7ec-49e6-91e1-117b50b70c43'} Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:08:40.929894 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. Jul 21 18:08:40.931381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:08:40.935830 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bf96dc98-928e-4988-8b2b-284385f058a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Returning 404 to user: Instance 0f527049-c7ec-49e6-91e1-117b50b70c43 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:08:40.935830 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bf96dc98-928e-4988-8b2b-284385f058a9 tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43" status: 404 len: 111 microversion: 2.20 time: 0.044350 Jul 21 18:08:40.935830 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 758/1503] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:08:40 2022] GET /compute/v2.1/servers/0f527049-c7ec-49e6-91e1-117b50b70c43 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 18:08:42.118651 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5c60dbff-8e64-4d42-9c46-bc650cd6427f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:42.119421 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5c60dbff-8e64-4d42-9c46-bc650cd6427f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:42.126324 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c60dbff-8e64-4d42-9c46-bc650cd6427f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:42.126769 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c60dbff-8e64-4d42-9c46-bc650cd6427f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:42.127545 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c60dbff-8e64-4d42-9c46-bc650cd6427f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:42.127977 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c60dbff-8e64-4d42-9c46-bc650cd6427f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:42.141741 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-5c60dbff-8e64-4d42-9c46-bc650cd6427f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] HTTP exception thrown: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5c60dbff-8e64-4d42-9c46-bc650cd6427f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Request method failure captured: Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 HTTP/1.1 Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2ZMHOxJgAvMbgMW0iaUKM89p8tyHINXCyN5GwXdmdLf4H_EXsTcwqakpWLNfBrMoQYY5Vq9J0jZNTE29giQQ4PbkTLiH49q0mVJp__vp3nGdUYTLD31aNGu8bRcZ0LFTOeoMvjwdug90r9Jn3l1n4tEXj_Bvy8Nz-Y5X7oMjE-xqz3U Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 444abcf11d564f7692af245f2bd98a84 Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:08:42.143309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:08:42.145089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/444abcf11d564f7692af245f2bd98a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/444abcf11d564f7692af245f2bd98a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_444abcf11d564f7692af245f2bd98a84", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/444abcf11d564f7692af245f2bd98a84"}]}] Jul 21 18:08:42.145089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:42.145089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 444abcf11d564f7692af245f2bd98a84 Jul 21 18:08:42.145089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:42.145089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeShelveTestJSON-951849365-project Jul 21 18:08:42.145089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:08:42.145089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:08:42.145089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: d08a5eaa6d814e388b0af0581a530888 Jul 21 18:08:42.145089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeShelveTestJSON-951849365-project Jul 21 18:08:42.145089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:08:42.145089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:08:42.145089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '38995733-7a8d-41fd-8517-ad9b23969807'} Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:08:42.146729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:08:42.148313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:08:42.149879 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5c60dbff-8e64-4d42-9c46-bc650cd6427f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Returning 404 to user: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:08:42.149879 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5c60dbff-8e64-4d42-9c46-bc650cd6427f tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "DELETE /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 404 len: 111 microversion: 2.20 time: 0.030368 Jul 21 18:08:42.149879 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 746/1504] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jul 21 18:08:42 2022] DELETE /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 18:08:42.154234 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5ced491c-5578-42a7-ae36-894c481130de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:42.154967 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5ced491c-5578-42a7-ae36-894c481130de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] [instance: 38995733-7a8d-41fd-8517-ad9b23969807] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:42.162212 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ced491c-5578-42a7-ae36-894c481130de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:42.162506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ced491c-5578-42a7-ae36-894c481130de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:42.163294 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ced491c-5578-42a7-ae36-894c481130de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:42.163733 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ced491c-5578-42a7-ae36-894c481130de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:42.177654 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-5ced491c-5578-42a7-ae36-894c481130de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] HTTP exception thrown: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5ced491c-5578-42a7-ae36-894c481130de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Request method failure captured: Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 HTTP/1.1 Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2ZMHOxJgAvMbgMW0iaUKM89p8tyHINXCyN5GwXdmdLf4H_EXsTcwqakpWLNfBrMoQYY5Vq9J0jZNTE29giQQ4PbkTLiH49q0mVJp__vp3nGdUYTLD31aNGu8bRcZ0LFTOeoMvjwdug90r9Jn3l1n4tEXj_Bvy8Nz-Y5X7oMjE-xqz3U Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 444abcf11d564f7692af245f2bd98a84 Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:08:42.179163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:08:42.180972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/444abcf11d564f7692af245f2bd98a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/444abcf11d564f7692af245f2bd98a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_444abcf11d564f7692af245f2bd98a84", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/444abcf11d564f7692af245f2bd98a84"}]}] Jul 21 18:08:42.180972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:42.180972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 444abcf11d564f7692af245f2bd98a84 Jul 21 18:08:42.180972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-951849365 Jul 21 18:08:42.180972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-AttachVolumeShelveTestJSON-951849365-project Jul 21 18:08:42.180972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:08:42.180972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:08:42.180972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: d08a5eaa6d814e388b0af0581a530888 Jul 21 18:08:42.180972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-AttachVolumeShelveTestJSON-951849365-project Jul 21 18:08:42.180972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:08:42.180972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:08:42.180972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '38995733-7a8d-41fd-8517-ad9b23969807'} Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:08:42.181837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. Jul 21 18:08:42.183161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:08:42.184366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5ced491c-5578-42a7-ae36-894c481130de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] Returning 404 to user: Instance 38995733-7a8d-41fd-8517-ad9b23969807 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:08:42.184366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5ced491c-5578-42a7-ae36-894c481130de tempest-AttachVolumeShelveTestJSON-951849365 tempest-AttachVolumeShelveTestJSON-951849365-project] 10.222.0.57 "GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807" status: 404 len: 111 microversion: 2.20 time: 0.030124 Jul 21 18:08:42.184366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 759/1505] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jul 21 18:08:42 2022] GET /compute/v2.1/servers/38995733-7a8d-41fd-8517-ad9b23969807 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 18:08:58.218996 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1011844147", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1392459256", "security_groups": [{"name": "tempest-secgroup-smoke-670077957"}], "block_device_mapping_v2": [{"uuid": "e571a310-9f0b-4aa3-9f65-3b01fd072f8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0e284ef-40f5-48ad-ba5a-1c18c4604cd6"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:08:58.229061 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:08:58.229931 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:08:58.450689 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] validate_networks() for [('b0e284ef-40f5-48ad-ba5a-1c18c4604cd6', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 18:08:58.839998 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 18:08:58.840548 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 18:08:58.841217 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 18:08:58.841840 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 18:08:58.842329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 18:08:58.851837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:58.852288 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:58.853113 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:08:58.853548 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:08:58.871708 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Getting quotas for project 076a5b3e4cd141b9bd9ef199e0fa0ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:08:58.875645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Getting quotas for user 293d4ca894e24e4fb6c4e7aa14256d78 and project 076a5b3e4cd141b9bd9ef199e0fa0ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:08:58.939704 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 18:08:58.942505 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e571a310-9f0b-4aa3-9f65-3b01fd072f8c',volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 18:08:59.078522 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a94047b6-b3ba-459d-be81-9a5fb2ef5ea9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.863808 Jul 21 18:08:59.079169 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 747/1506] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 18:08:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 18:08:59.090934 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e1d26376-d1da-4c09-aaf2-f78b455cfd52 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:08:59.091567 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e1d26376-d1da-4c09-aaf2-f78b455cfd52 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:08:59.094028 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=4 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:08:59.094704 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:08:59.095634 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=22 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:08:59.314251 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e1d26376-d1da-4c09-aaf2-f78b455cfd52 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:08:59.322590 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e1d26376-d1da-4c09-aaf2-f78b455cfd52 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1095 microversion: 2.1 time: 0.236680 Jul 21 18:08:59.333738 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 760/1507] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:08:59 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1095 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:00.341300 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-99acec8d-7408-458b-8c90-d106c564b17d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:00.344118 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-99acec8d-7408-458b-8c90-d106c564b17d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:00.351663 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99acec8d-7408-458b-8c90-d106c564b17d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:00.353089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99acec8d-7408-458b-8c90-d106c564b17d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:00.354067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99acec8d-7408-458b-8c90-d106c564b17d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:00.354511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-99acec8d-7408-458b-8c90-d106c564b17d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:00.433542 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-99acec8d-7408-458b-8c90-d106c564b17d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:00.443760 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-99acec8d-7408-458b-8c90-d106c564b17d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1211 microversion: 2.1 time: 0.107380 Jul 21 18:09:00.444504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 748/1508] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:00 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:09:01.462187 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-52c68b7f-f6a6-44ce-8939-1c08844e46ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:01.462670 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-52c68b7f-f6a6-44ce-8939-1c08844e46ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:01.472676 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52c68b7f-f6a6-44ce-8939-1c08844e46ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:01.473474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52c68b7f-f6a6-44ce-8939-1c08844e46ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:01.474501 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52c68b7f-f6a6-44ce-8939-1c08844e46ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:01.475221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52c68b7f-f6a6-44ce-8939-1c08844e46ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:01.672604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-52c68b7f-f6a6-44ce-8939-1c08844e46ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:01.682467 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-52c68b7f-f6a6-44ce-8939-1c08844e46ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.225043 Jul 21 18:09:01.683437 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 761/1509] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:01 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:01.739224 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-e42503d4-8116-42b8-8d14-39061fa3a75f req-5dd1053b-50a6-4967-8271-79754c236b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3032f69c-16ce-43d7-8d6c-38275854c874", "tag": "288ab40e-838d-4925-87e6-b371de73f01a"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:09:01.754266 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-e42503d4-8116-42b8-8d14-39061fa3a75f req-5dd1053b-50a6-4967-8271-79754c236b5f service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:01.754700 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-e42503d4-8116-42b8-8d14-39061fa3a75f req-5dd1053b-50a6-4967-8271-79754c236b5f service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:01.776156 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-e42503d4-8116-42b8-8d14-39061fa3a75f req-5dd1053b-50a6-4967-8271-79754c236b5f service nova] Creating event network-changed:288ab40e-838d-4925-87e6-b371de73f01a for instance 3032f69c-16ce-43d7-8d6c-38275854c874 on hv-cinder-82549 Jul 21 18:09:01.787167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-e42503d4-8116-42b8-8d14-39061fa3a75f req-5dd1053b-50a6-4967-8271-79754c236b5f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051730 Jul 21 18:09:01.788340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 749/1510] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:09:02.382423 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f2bb8ea2-a0af-4117-9533-9c5ca926c9a4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:02.382918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f2bb8ea2-a0af-4117-9533-9c5ca926c9a4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:02.388874 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f2bb8ea2-a0af-4117-9533-9c5ca926c9a4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:02.389322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f2bb8ea2-a0af-4117-9533-9c5ca926c9a4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:02.390078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f2bb8ea2-a0af-4117-9533-9c5ca926c9a4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:02.390514 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f2bb8ea2-a0af-4117-9533-9c5ca926c9a4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:02.405325 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-f2bb8ea2-a0af-4117-9533-9c5ca926c9a4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] HTTP exception thrown: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f2bb8ea2-a0af-4117-9533-9c5ca926c9a4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Request method failure captured: Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: DELETE /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 HTTP/1.1 Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Y4MLMBby9pVb6fwZuBjDRRu9HKRFu1ubjEDLV-WnX1WKQKVX_XMZ4Yqw6FkUH0RRqITWcDICF4pmsesAnL59Rfd9lRL-u5FtRZh9LwiE1kZl5RReoX0EElUgVwXfWiOqjbNCaVPpfluVfKkWpY7Bs2i6epWgLEEnsNP5LGqfJDuT0g Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:09:02.406837 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:09:02.408740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0917b2a75df4a9ab1d2cbd4fd3f7613", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}] Jul 21 18:09:02.408740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:09:02.408740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 18:09:02.408740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:09:02.408740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 18:09:02.408740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:09:02.408740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:09:02.408740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: fa82bddf9aa0455797d42993fe850ccf Jul 21 18:09:02.408740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 18:09:02.408740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:09:02.408740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 18:09:02.408740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7'} Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:09:02.409722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 18:09:02.411512 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:02.413290 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f2bb8ea2-a0af-4117-9533-9c5ca926c9a4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Returning 404 to user: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:09:02.413290 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f2bb8ea2-a0af-4117-9533-9c5ca926c9a4 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 404 len: 111 microversion: 2.1 time: 0.030080 Jul 21 18:09:02.413290 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 762/1511] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:09:02 2022] DELETE /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:09:02.417620 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ae568857-74f2-484f-9292-19da9ab25234 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:02.418334 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ae568857-74f2-484f-9292-19da9ab25234 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:02.424833 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae568857-74f2-484f-9292-19da9ab25234 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:02.425233 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae568857-74f2-484f-9292-19da9ab25234 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:02.426271 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae568857-74f2-484f-9292-19da9ab25234 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:02.426974 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae568857-74f2-484f-9292-19da9ab25234 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:02.443096 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-ae568857-74f2-484f-9292-19da9ab25234 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] HTTP exception thrown: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ae568857-74f2-484f-9292-19da9ab25234 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Request method failure captured: Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 HTTP/1.1 Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y4MLMBby9pVb6fwZuBjDRRu9HKRFu1ubjEDLV-WnX1WKQKVX_XMZ4Yqw6FkUH0RRqITWcDICF4pmsesAnL59Rfd9lRL-u5FtRZh9LwiE1kZl5RReoX0EElUgVwXfWiOqjbNCaVPpfluVfKkWpY7Bs2i6epWgLEEnsNP5LGqfJDuT0g Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:09:02.444801 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:09:02.446824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0917b2a75df4a9ab1d2cbd4fd3f7613", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}] Jul 21 18:09:02.446824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:09:02.446824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 18:09:02.446824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:09:02.446824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 18:09:02.446824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:09:02.446824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:09:02.446824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: fa82bddf9aa0455797d42993fe850ccf Jul 21 18:09:02.446824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 18:09:02.446824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:09:02.446824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 18:09:02.446824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7'} Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:09:02.447799 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. Jul 21 18:09:02.449576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:02.451285 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ae568857-74f2-484f-9292-19da9ab25234 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Returning 404 to user: Instance 8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:09:02.451285 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ae568857-74f2-484f-9292-19da9ab25234 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7" status: 404 len: 111 microversion: 2.1 time: 0.032929 Jul 21 18:09:02.451285 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 750/1512] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:02 2022] GET /compute/v2.1/servers/8147b0f1-8d42-4e7b-a8b4-77a10aef1cc7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:09:02.701061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-15d793ac-d20a-466f-99d2-6b5c1f169825 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:02.701678 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-15d793ac-d20a-466f-99d2-6b5c1f169825 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:02.708903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-15d793ac-d20a-466f-99d2-6b5c1f169825 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:02.709351 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-15d793ac-d20a-466f-99d2-6b5c1f169825 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:02.710120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-15d793ac-d20a-466f-99d2-6b5c1f169825 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:02.710617 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-15d793ac-d20a-466f-99d2-6b5c1f169825 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:02.850076 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-15d793ac-d20a-466f-99d2-6b5c1f169825 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:02.858152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-15d793ac-d20a-466f-99d2-6b5c1f169825 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.160860 Jul 21 18:09:02.859034 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 763/1513] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:02 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:03.583839 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cc3a7cdd-ce34-4545-9b09-a59fe52ed740 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:03.584371 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cc3a7cdd-ce34-4545-9b09-a59fe52ed740 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:03.590774 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cc3a7cdd-ce34-4545-9b09-a59fe52ed740 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:03.591228 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cc3a7cdd-ce34-4545-9b09-a59fe52ed740 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:03.591997 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cc3a7cdd-ce34-4545-9b09-a59fe52ed740 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:03.592473 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cc3a7cdd-ce34-4545-9b09-a59fe52ed740 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:03.606317 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-cc3a7cdd-ce34-4545-9b09-a59fe52ed740 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] HTTP exception thrown: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cc3a7cdd-ce34-4545-9b09-a59fe52ed740 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Request method failure captured: Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 HTTP/1.1 Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y4MLMBby9pVb6fwZuBjDRRu9HKRFu1ubjEDLV-WnX1WKQKVX_XMZ4Yqw6FkUH0RRqITWcDICF4pmsesAnL59Rfd9lRL-u5FtRZh9LwiE1kZl5RReoX0EElUgVwXfWiOqjbNCaVPpfluVfKkWpY7Bs2i6epWgLEEnsNP5LGqfJDuT0g Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:09:03.607874 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:09:03.609638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0917b2a75df4a9ab1d2cbd4fd3f7613", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}] Jul 21 18:09:03.609638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:09:03.609638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 18:09:03.609638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:09:03.609638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 18:09:03.609638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:09:03.609638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:09:03.609638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: fa82bddf9aa0455797d42993fe850ccf Jul 21 18:09:03.609638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 18:09:03.609638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:09:03.609638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 18:09:03.609638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '2da2560b-0f95-4dac-9745-d34cecc16575'} Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:09:03.610710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 18:09:03.612365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:03.614045 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cc3a7cdd-ce34-4545-9b09-a59fe52ed740 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Returning 404 to user: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:09:03.614045 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cc3a7cdd-ce34-4545-9b09-a59fe52ed740 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 404 len: 111 microversion: 2.1 time: 0.029727 Jul 21 18:09:03.614045 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 751/1514] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:09:03 2022] DELETE /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:09:03.617822 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a872c619-c791-4fb1-af98-ce4f48903b62 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:03.618437 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a872c619-c791-4fb1-af98-ce4f48903b62 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] [instance: 2da2560b-0f95-4dac-9745-d34cecc16575] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:03.624545 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a872c619-c791-4fb1-af98-ce4f48903b62 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:03.624996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a872c619-c791-4fb1-af98-ce4f48903b62 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:03.625761 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a872c619-c791-4fb1-af98-ce4f48903b62 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:03.626201 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a872c619-c791-4fb1-af98-ce4f48903b62 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:03.639267 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-a872c619-c791-4fb1-af98-ce4f48903b62 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] HTTP exception thrown: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a872c619-c791-4fb1-af98-ce4f48903b62 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Request method failure captured: Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 HTTP/1.1 Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Y4MLMBby9pVb6fwZuBjDRRu9HKRFu1ubjEDLV-WnX1WKQKVX_XMZ4Yqw6FkUH0RRqITWcDICF4pmsesAnL59Rfd9lRL-u5FtRZh9LwiE1kZl5RReoX0EElUgVwXfWiOqjbNCaVPpfluVfKkWpY7Bs2i6epWgLEEnsNP5LGqfJDuT0g Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:09:03.640866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:09:03.642602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0917b2a75df4a9ab1d2cbd4fd3f7613", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0917b2a75df4a9ab1d2cbd4fd3f7613"}]}] Jul 21 18:09:03.642602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:09:03.642602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: b0917b2a75df4a9ab1d2cbd4fd3f7613 Jul 21 18:09:03.642602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1482897000 Jul 21 18:09:03.642602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 18:09:03.642602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:09:03.642602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:09:03.642602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: fa82bddf9aa0455797d42993fe850ccf Jul 21 18:09:03.642602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-AttachVolumeNegativeTest-1482897000-project Jul 21 18:09:03.642602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:09:03.642602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 18:09:03.642602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '2da2560b-0f95-4dac-9745-d34cecc16575'} Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:09:03.643549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. Jul 21 18:09:03.645780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:03.647213 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a872c619-c791-4fb1-af98-ce4f48903b62 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] Returning 404 to user: Instance 2da2560b-0f95-4dac-9745-d34cecc16575 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:09:03.647213 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a872c619-c791-4fb1-af98-ce4f48903b62 tempest-AttachVolumeNegativeTest-1482897000 tempest-AttachVolumeNegativeTest-1482897000-project] 10.222.0.57 "GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575" status: 404 len: 111 microversion: 2.1 time: 0.028394 Jul 21 18:09:03.647213 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 764/1515] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:03 2022] GET /compute/v2.1/servers/2da2560b-0f95-4dac-9745-d34cecc16575 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:09:03.876175 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b4ef5c06-6dbf-4e5c-932c-dfe956223988 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:03.876855 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b4ef5c06-6dbf-4e5c-932c-dfe956223988 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:03.883186 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4ef5c06-6dbf-4e5c-932c-dfe956223988 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:03.883639 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4ef5c06-6dbf-4e5c-932c-dfe956223988 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:03.884433 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4ef5c06-6dbf-4e5c-932c-dfe956223988 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:03.884994 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4ef5c06-6dbf-4e5c-932c-dfe956223988 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:04.023054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b4ef5c06-6dbf-4e5c-932c-dfe956223988 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:04.030621 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b4ef5c06-6dbf-4e5c-932c-dfe956223988 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.158305 Jul 21 18:09:04.031194 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 752/1516] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:03 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:05.047755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3377c0d2-dda5-4632-957e-9ec01e25d0d0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:05.048670 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3377c0d2-dda5-4632-957e-9ec01e25d0d0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:05.059132 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3377c0d2-dda5-4632-957e-9ec01e25d0d0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:05.059588 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3377c0d2-dda5-4632-957e-9ec01e25d0d0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:05.060402 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3377c0d2-dda5-4632-957e-9ec01e25d0d0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:05.060849 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3377c0d2-dda5-4632-957e-9ec01e25d0d0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:05.198627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3377c0d2-dda5-4632-957e-9ec01e25d0d0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:05.206295 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3377c0d2-dda5-4632-957e-9ec01e25d0d0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.162664 Jul 21 18:09:05.206873 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 765/1517] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:05 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:06.224098 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0d8ef167-3a0f-4c59-90bd-00b34c7c51e3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:06.224905 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0d8ef167-3a0f-4c59-90bd-00b34c7c51e3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:06.231030 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d8ef167-3a0f-4c59-90bd-00b34c7c51e3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:06.231557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d8ef167-3a0f-4c59-90bd-00b34c7c51e3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:06.232433 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d8ef167-3a0f-4c59-90bd-00b34c7c51e3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:06.232972 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d8ef167-3a0f-4c59-90bd-00b34c7c51e3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:06.381960 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0d8ef167-3a0f-4c59-90bd-00b34c7c51e3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:06.402773 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0d8ef167-3a0f-4c59-90bd-00b34c7c51e3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.183438 Jul 21 18:09:06.403570 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 753/1518] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:06 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:07.420754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6d026ec4-8002-41a9-9e1b-b7cc453c2aa0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:07.421379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6d026ec4-8002-41a9-9e1b-b7cc453c2aa0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:07.428096 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d026ec4-8002-41a9-9e1b-b7cc453c2aa0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:07.428592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d026ec4-8002-41a9-9e1b-b7cc453c2aa0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:07.429367 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d026ec4-8002-41a9-9e1b-b7cc453c2aa0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:07.429814 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6d026ec4-8002-41a9-9e1b-b7cc453c2aa0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:07.563809 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6d026ec4-8002-41a9-9e1b-b7cc453c2aa0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:07.571928 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6d026ec4-8002-41a9-9e1b-b7cc453c2aa0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.155025 Jul 21 18:09:07.572460 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 766/1519] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:07 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:08.143483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-298ff58e-58f9-46bf-8f2d-7d42af904cf9 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Action: 'create', calling method: .version_select at 0x7ffa2ed349d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-515632976"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:09:08.437522 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-298ff58e-58f9-46bf-8f2d-7d42af904cf9 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.410464 Jul 21 18:09:08.438292 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 754/1520] 10.222.0.57 () {60 vars in 1154 bytes} [Thu Jul 21 18:09:08 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 412 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 18:09:08.450887 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2a5c39fc-cf4d-4ffb-8d0e-f7cc1b104df4 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2a68d0d0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:08.514786 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2a5c39fc-cf4d-4ffb-8d0e-f7cc1b104df4 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3" status: 200 len: 344 microversion: 2.1 time: 0.068913 Jul 21 18:09:08.515361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 767/1521] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 18:09:08 2022] GET /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:09:08.588889 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5618b94f-3d67-441a-9bc5-50c7784c160b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:08.589638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5618b94f-3d67-441a-9bc5-50c7784c160b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:08.598635 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5618b94f-3d67-441a-9bc5-50c7784c160b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:08.598635 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5618b94f-3d67-441a-9bc5-50c7784c160b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:08.598635 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5618b94f-3d67-441a-9bc5-50c7784c160b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:08.598987 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5618b94f-3d67-441a-9bc5-50c7784c160b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:08.737091 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5618b94f-3d67-441a-9bc5-50c7784c160b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:08.746949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5618b94f-3d67-441a-9bc5-50c7784c160b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.161726 Jul 21 18:09:08.747753 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 755/1522] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:08 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:09.524978 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:09:09.529764 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c414f2ca-aa12-4059-9054-1e293511a3f2 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2ecf15e0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:09.576203 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c414f2ca-aa12-4059-9054-1e293511a3f2 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3" status: 200 len: 345 microversion: 2.1 time: 0.051957 Jul 21 18:09:09.576830 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 768/1523] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 18:09:09 2022] GET /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:09:09.587757 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d1c8eddb-53b7-4f6c-9a6c-5dd53b670bfb tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Action: 'create', calling method: .version_select at 0x7ffa2a3a0670>, body: {"snapshot": {"volume_id": "487b174f-9d59-47f5-afc9-33d6768c05a3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1731142533"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:09:09.594344 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:09:09.595080 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:09:09.736969 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d1c8eddb-53b7-4f6c-9a6c-5dd53b670bfb tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.152861 Jul 21 18:09:09.737656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 756/1524] 10.222.0.57 () {60 vars in 1161 bytes} [Thu Jul 21 18:09:09 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:09:09.748139 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ff36468a-ecb5-4e09-acc7-725e3a5df904 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2ecaad30>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:09.764976 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dff5a37f-0034-4ab0-9a7c-14b2aed18f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:09.765616 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dff5a37f-0034-4ab0-9a7c-14b2aed18f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:09.776261 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dff5a37f-0034-4ab0-9a7c-14b2aed18f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:09.776742 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dff5a37f-0034-4ab0-9a7c-14b2aed18f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:09.777528 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dff5a37f-0034-4ab0-9a7c-14b2aed18f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:09.777973 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dff5a37f-0034-4ab0-9a7c-14b2aed18f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:09.786189 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ff36468a-ecb5-4e09-acc7-725e3a5df904 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343" status: 200 len: 287 microversion: 2.1 time: 0.042072 Jul 21 18:09:09.786872 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 769/1525] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 18:09:09 2022] GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:09:09.796801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2a5c9f66-5257-4563-8793-31c2ae22b887 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2ecf1700>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:09.832339 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2a5c9f66-5257-4563-8793-31c2ae22b887 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.038617 Jul 21 18:09:09.833303 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 770/1526] 10.222.0.57 () {58 vars in 1139 bytes} [Thu Jul 21 18:09:09 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:09:09.843321 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6a64fafa-15ab-4ae9-b475-c3d7bfe57f7a tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2a68dc10>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:09.914487 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6a64fafa-15ab-4ae9-b475-c3d7bfe57f7a tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343" status: 200 len: 287 microversion: 2.1 time: 0.074061 Jul 21 18:09:09.915077 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 771/1527] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 18:09:09 2022] GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:09:09.933821 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dff5a37f-0034-4ab0-9a7c-14b2aed18f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:09.942290 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dff5a37f-0034-4ab0-9a7c-14b2aed18f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.181470 Jul 21 18:09:09.942864 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 757/1528] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:09 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:09:10.928464 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-2d067c91-31d4-48f7-8dec-9c7f3a976424 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2ecaa0d0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:10.959573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5c54afa6-be2c-4e95-83a6-5080ea87e8e4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:10.960264 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5c54afa6-be2c-4e95-83a6-5080ea87e8e4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:10.961757 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-2d067c91-31d4-48f7-8dec-9c7f3a976424 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343" status: 200 len: 287 microversion: 2.1 time: 0.038794 Jul 21 18:09:10.962331 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 772/1529] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 18:09:10 2022] GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:09:10.973739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c54afa6-be2c-4e95-83a6-5080ea87e8e4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:10.974190 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c54afa6-be2c-4e95-83a6-5080ea87e8e4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:10.974967 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c54afa6-be2c-4e95-83a6-5080ea87e8e4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:10.975405 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5c54afa6-be2c-4e95-83a6-5080ea87e8e4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:11.105087 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5c54afa6-be2c-4e95-83a6-5080ea87e8e4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:11.112506 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5c54afa6-be2c-4e95-83a6-5080ea87e8e4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.157453 Jul 21 18:09:11.113180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 758/1530] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:10 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:09:11.974269 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7a7c60fa-4d0a-41ad-8290-0c1c1e351aef tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2a404040>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:12.003949 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7a7c60fa-4d0a-41ad-8290-0c1c1e351aef tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343" status: 200 len: 287 microversion: 2.1 time: 0.033953 Jul 21 18:09:12.004547 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 773/1531] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 18:09:11 2022] GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:09:12.129889 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eae3d25c-6451-460a-9812-49c2e53aea75 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:12.130503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eae3d25c-6451-460a-9812-49c2e53aea75 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:12.137115 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eae3d25c-6451-460a-9812-49c2e53aea75 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:12.137571 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eae3d25c-6451-460a-9812-49c2e53aea75 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:12.138343 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eae3d25c-6451-460a-9812-49c2e53aea75 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:12.138789 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eae3d25c-6451-460a-9812-49c2e53aea75 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:12.273684 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-eae3d25c-6451-460a-9812-49c2e53aea75 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:12.281146 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eae3d25c-6451-460a-9812-49c2e53aea75 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.155722 Jul 21 18:09:12.281716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 759/1532] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:12 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:13.016592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-02d9b063-0d71-427e-8589-399a52f22fed tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2ecaab80>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:13.049414 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-02d9b063-0d71-427e-8589-399a52f22fed tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343" status: 200 len: 288 microversion: 2.1 time: 0.037703 Jul 21 18:09:13.050588 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 774/1533] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 18:09:13 2022] GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343 => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:09:13.060949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-86c2a1f8-5fea-442a-9ba9-b7b48e69f152 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2a541ee0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:13.125516 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-86c2a1f8-5fea-442a-9ba9-b7b48e69f152 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343" status: 202 len: 0 microversion: 2.1 time: 0.068603 Jul 21 18:09:13.126098 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 760/1534] 10.222.0.57 () {58 vars in 1253 bytes} [Thu Jul 21 18:09:13 2022] DELETE /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:09:13.134306 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fa3ec960-3750-46d3-82c1-15bd02e5294a tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2ecaaaf0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:13.164422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fa3ec960-3750-46d3-82c1-15bd02e5294a tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343" status: 200 len: 287 microversion: 2.1 time: 0.033863 Jul 21 18:09:13.165096 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 775/1535] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 18:09:13 2022] GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:09:13.298752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-04fb1497-a4a2-4509-8a74-d492ff6b2f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:13.299363 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-04fb1497-a4a2-4509-8a74-d492ff6b2f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:13.305888 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04fb1497-a4a2-4509-8a74-d492ff6b2f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:13.306341 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04fb1497-a4a2-4509-8a74-d492ff6b2f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:13.307210 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04fb1497-a4a2-4509-8a74-d492ff6b2f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:13.307648 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04fb1497-a4a2-4509-8a74-d492ff6b2f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:13.450497 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-04fb1497-a4a2-4509-8a74-d492ff6b2f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:13.450497 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-04fb1497-a4a2-4509-8a74-d492ff6b2f82 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.155845 Jul 21 18:09:13.450771 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 761/1536] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:13 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:14.177608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-98dd8b0f-d2f7-4d1a-b502-e8f38f746933 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2ec600d0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:14.206139 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-98dd8b0f-d2f7-4d1a-b502-e8f38f746933 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] HTTP exception thrown: Snapshot 917b4c9d-9829-4de4-b233-4eb8da8a1343 could not be found. Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-98dd8b0f-d2f7-4d1a-b502-e8f38f746933 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Request method failure captured: Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343 HTTP/1.1 Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2ZZDLalF0wtUUsF-ATLNuZlr_BmR_MDw2_GFzLt2tkgR72tl8hEfMO7C5yPNbhS88BmvlRQn_gdmmS-sI_qXiiDe6yVAykrXtGPBgcDz5eZzB1rqIYtzdsnO9o5N8cxWeZmAPgU_Ht-NXR90sO1RIrJGkc1obVRllOt9YHRLhxItDis Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: c1a13a032ddb4e90a889b9e82c3fbd37 Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-959067067 Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:09:14.210141 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1a13a032ddb4e90a889b9e82c3fbd37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1a13a032ddb4e90a889b9e82c3fbd37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c1a13a032ddb4e90a889b9e82c3fbd37", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c1a13a032ddb4e90a889b9e82c3fbd37"}]}] Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-VolumesSnapshotsTestJSON-959067067 Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: c1a13a032ddb4e90a889b9e82c3fbd37 Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-959067067 Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-VolumesSnapshotsTestJSON-959067067-project Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: d1c3026447e0439c9aa4d40541418ecb Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-VolumesSnapshotsTestJSON-959067067-project Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Snapshot 917b4c9d-9829-4de4-b233-4eb8da8a1343 could not be found. Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '917b4c9d-9829-4de4-b233-4eb8da8a1343'} Jul 21 18:09:14.211929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 917b4c9d-9829-4de4-b233-4eb8da8a1343 could not be found. (HTTP 404) (Request-ID: req-dd56f57b-9bfb-4f40-b248-2092406face9) Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:14.213219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 18:09:14.214785 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 917b4c9d-9829-4de4-b233-4eb8da8a1343 could not be found. Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 21 18:09:14.216503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 917b4c9d-9829-4de4-b233-4eb8da8a1343 could not be found. Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 917b4c9d-9829-4de4-b233-4eb8da8a1343 could not be found. Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-98dd8b0f-d2f7-4d1a-b502-e8f38f746933 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Returning 404 to user: Snapshot 917b4c9d-9829-4de4-b233-4eb8da8a1343 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:09:14.218127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-98dd8b0f-d2f7-4d1a-b502-e8f38f746933 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343" status: 404 len: 111 microversion: 2.1 time: 0.038982 Jul 21 18:09:14.219204 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 776/1537] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 18:09:14 2022] GET /compute/v2.1/os-snapshots/917b4c9d-9829-4de4-b233-4eb8da8a1343 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:09:14.220111 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3a03ad29-56fb-4b2f-afe6-32e6fc9820ab tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2a5b6ee0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:14.281492 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3a03ad29-56fb-4b2f-afe6-32e6fc9820ab tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3" status: 202 len: 0 microversion: 2.1 time: 0.065093 Jul 21 18:09:14.282038 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 762/1538] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 18:09:14 2022] DELETE /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 18:09:14.291110 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1e10d53d-bf67-4065-85f9-d39505f8b44b tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2ec77820>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:14.340206 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1e10d53d-bf67-4065-85f9-d39505f8b44b tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3" status: 200 len: 344 microversion: 2.1 time: 0.053552 Jul 21 18:09:14.340805 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 777/1539] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 18:09:14 2022] GET /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:09:14.468059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-60cf6b9d-8e75-4a17-aa26-6c0d071c8f37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:14.468699 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-60cf6b9d-8e75-4a17-aa26-6c0d071c8f37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:14.475850 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60cf6b9d-8e75-4a17-aa26-6c0d071c8f37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:14.476317 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60cf6b9d-8e75-4a17-aa26-6c0d071c8f37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:14.477083 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60cf6b9d-8e75-4a17-aa26-6c0d071c8f37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:14.477535 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60cf6b9d-8e75-4a17-aa26-6c0d071c8f37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:14.618670 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-60cf6b9d-8e75-4a17-aa26-6c0d071c8f37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:14.626076 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-60cf6b9d-8e75-4a17-aa26-6c0d071c8f37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.162514 Jul 21 18:09:14.626638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 763/1540] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:14 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:14.773359 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-06fa7e48-ff95-4fe3-9ad0-8e063839ba17 req-bac68fe6-136d-4fea-be27-a31aca51e34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3032f69c-16ce-43d7-8d6c-38275854c874", "name": "network-vif-plugged", "status": "completed", "tag": "288ab40e-838d-4925-87e6-b371de73f01a"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:09:14.782016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-06fa7e48-ff95-4fe3-9ad0-8e063839ba17 req-bac68fe6-136d-4fea-be27-a31aca51e34f service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:14.782567 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-06fa7e48-ff95-4fe3-9ad0-8e063839ba17 req-bac68fe6-136d-4fea-be27-a31aca51e34f service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:14.795741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-06fa7e48-ff95-4fe3-9ad0-8e063839ba17 req-bac68fe6-136d-4fea-be27-a31aca51e34f service nova] Creating event network-vif-plugged:288ab40e-838d-4925-87e6-b371de73f01a for instance 3032f69c-16ce-43d7-8d6c-38275854c874 on hv-cinder-82549 Jul 21 18:09:14.802577 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-06fa7e48-ff95-4fe3-9ad0-8e063839ba17 req-bac68fe6-136d-4fea-be27-a31aca51e34f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035331 Jul 21 18:09:14.803422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 778/1541] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:09:15.354028 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c006aed2-a8d5-43af-909e-c2c9f32003c7 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2a59faf0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:15.381137 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-c006aed2-a8d5-43af-909e-c2c9f32003c7 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] HTTP exception thrown: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c006aed2-a8d5-43af-909e-c2c9f32003c7 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Request method failure captured: Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3 HTTP/1.1 Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2ZZDLalF0wtUUsF-ATLNuZlr_BmR_MDw2_GFzLt2tkgR72tl8hEfMO7C5yPNbhS88BmvlRQn_gdmmS-sI_qXiiDe6yVAykrXtGPBgcDz5eZzB1rqIYtzdsnO9o5N8cxWeZmAPgU_Ht-NXR90sO1RIrJGkc1obVRllOt9YHRLhxItDis Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: c1a13a032ddb4e90a889b9e82c3fbd37 Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-959067067 Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:09:15.383067 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1a13a032ddb4e90a889b9e82c3fbd37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1a13a032ddb4e90a889b9e82c3fbd37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c1a13a032ddb4e90a889b9e82c3fbd37", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c1a13a032ddb4e90a889b9e82c3fbd37"}]}] Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesSnapshotsTestJSON-959067067 Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: c1a13a032ddb4e90a889b9e82c3fbd37 Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-959067067 Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesSnapshotsTestJSON-959067067-project Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: d1c3026447e0439c9aa4d40541418ecb Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesSnapshotsTestJSON-959067067-project Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '487b174f-9d59-47f5-afc9-33d6768c05a3'} Jul 21 18:09:15.384830 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. (HTTP 404) (Request-ID: req-6ffd5d53-8d47-43fb-8054-feb96c8cffc9) Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:15.385917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 18:09:15.388661 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 18:09:15.390921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c006aed2-a8d5-43af-909e-c2c9f32003c7 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Returning 404 to user: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c006aed2-a8d5-43af-909e-c2c9f32003c7 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3" status: 404 len: 109 microversion: 2.1 time: 0.034388 Jul 21 18:09:15.392472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 764/1542] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 18:09:15 2022] GET /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:09:15.399826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-17fd3cd1-afdb-48d5-833b-e878054a1c88 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2ecaa160>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:15.427729 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-17fd3cd1-afdb-48d5-833b-e878054a1c88 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] HTTP exception thrown: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-17fd3cd1-afdb-48d5-833b-e878054a1c88 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Request method failure captured: Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: DELETE /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3 HTTP/1.1 Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2ZZDLalF0wtUUsF-ATLNuZlr_BmR_MDw2_GFzLt2tkgR72tl8hEfMO7C5yPNbhS88BmvlRQn_gdmmS-sI_qXiiDe6yVAykrXtGPBgcDz5eZzB1rqIYtzdsnO9o5N8cxWeZmAPgU_Ht-NXR90sO1RIrJGkc1obVRllOt9YHRLhxItDis Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: c1a13a032ddb4e90a889b9e82c3fbd37 Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-959067067 Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:09:15.430152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1a13a032ddb4e90a889b9e82c3fbd37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1a13a032ddb4e90a889b9e82c3fbd37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c1a13a032ddb4e90a889b9e82c3fbd37", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c1a13a032ddb4e90a889b9e82c3fbd37"}]}] Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-VolumesSnapshotsTestJSON-959067067 Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: c1a13a032ddb4e90a889b9e82c3fbd37 Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-959067067 Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-VolumesSnapshotsTestJSON-959067067-project Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: d1c3026447e0439c9aa4d40541418ecb Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-VolumesSnapshotsTestJSON-959067067-project Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '487b174f-9d59-47f5-afc9-33d6768c05a3'} Jul 21 18:09:15.431903 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. (HTTP 404) (Request-ID: req-162d2f9b-f350-4dbc-98a4-e6431a86c2a5) Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:15.433135 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 18:09:15.435009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 18:09:15.436602 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-17fd3cd1-afdb-48d5-833b-e878054a1c88 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Returning 404 to user: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-17fd3cd1-afdb-48d5-833b-e878054a1c88 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3" status: 404 len: 109 microversion: 2.1 time: 0.036391 Jul 21 18:09:15.438137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 779/1543] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 18:09:15 2022] DELETE /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:09:15.439816 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e8b303f3-2a96-4a95-baa0-c87a3dd25d06 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Calling method '.version_select at 0x7ffa2ecd9af0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:15.467571 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-e8b303f3-2a96-4a95-baa0-c87a3dd25d06 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] HTTP exception thrown: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e8b303f3-2a96-4a95-baa0-c87a3dd25d06 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Request method failure captured: Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3 HTTP/1.1 Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2ZZDLalF0wtUUsF-ATLNuZlr_BmR_MDw2_GFzLt2tkgR72tl8hEfMO7C5yPNbhS88BmvlRQn_gdmmS-sI_qXiiDe6yVAykrXtGPBgcDz5eZzB1rqIYtzdsnO9o5N8cxWeZmAPgU_Ht-NXR90sO1RIrJGkc1obVRllOt9YHRLhxItDis Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: c1a13a032ddb4e90a889b9e82c3fbd37 Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-959067067 Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:09:15.469556 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1a13a032ddb4e90a889b9e82c3fbd37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c1a13a032ddb4e90a889b9e82c3fbd37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c1a13a032ddb4e90a889b9e82c3fbd37", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c1a13a032ddb4e90a889b9e82c3fbd37"}]}] Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesSnapshotsTestJSON-959067067 Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: c1a13a032ddb4e90a889b9e82c3fbd37 Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-959067067 Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesSnapshotsTestJSON-959067067-project Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: d1c3026447e0439c9aa4d40541418ecb Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesSnapshotsTestJSON-959067067-project Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '487b174f-9d59-47f5-afc9-33d6768c05a3'} Jul 21 18:09:15.473252 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. (HTTP 404) (Request-ID: req-fa7a61d5-bac4-4ee5-8976-a2714de39403) Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:15.474346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 18:09:15.475875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 18:09:15.477443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e8b303f3-2a96-4a95-baa0-c87a3dd25d06 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] Returning 404 to user: Volume 487b174f-9d59-47f5-afc9-33d6768c05a3 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e8b303f3-2a96-4a95-baa0-c87a3dd25d06 tempest-VolumesSnapshotsTestJSON-959067067 tempest-VolumesSnapshotsTestJSON-959067067-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3" status: 404 len: 109 microversion: 2.1 time: 0.034893 Jul 21 18:09:15.479397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 765/1544] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 18:09:15 2022] GET /compute/v2.1/os-volumes/487b174f-9d59-47f5-afc9-33d6768c05a3 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:09:15.642604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-126c0695-4168-4b9b-a895-efe1fb489e18 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:15.643374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-126c0695-4168-4b9b-a895-efe1fb489e18 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:15.651399 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-126c0695-4168-4b9b-a895-efe1fb489e18 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:15.651853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-126c0695-4168-4b9b-a895-efe1fb489e18 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:15.652655 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-126c0695-4168-4b9b-a895-efe1fb489e18 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:15.653101 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-126c0695-4168-4b9b-a895-efe1fb489e18 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:15.789656 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-126c0695-4168-4b9b-a895-efe1fb489e18 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:15.796994 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-126c0695-4168-4b9b-a895-efe1fb489e18 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1266 microversion: 2.1 time: 0.158075 Jul 21 18:09:15.797543 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 780/1545] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:15 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:16.814696 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-85d98a52-29d9-4fbe-b389-e30cacee6bf3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:16.816255 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-85d98a52-29d9-4fbe-b389-e30cacee6bf3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:16.821965 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-85d98a52-29d9-4fbe-b389-e30cacee6bf3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:16.822532 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-85d98a52-29d9-4fbe-b389-e30cacee6bf3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:16.823427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-85d98a52-29d9-4fbe-b389-e30cacee6bf3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:16.823868 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-85d98a52-29d9-4fbe-b389-e30cacee6bf3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:16.965533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-85d98a52-29d9-4fbe-b389-e30cacee6bf3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:16.974502 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-85d98a52-29d9-4fbe-b389-e30cacee6bf3 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1452 microversion: 2.1 time: 0.164005 Jul 21 18:09:16.975078 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 766/1546] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:16 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:16.990227 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ff0db4dd-e050-46dd-aa21-fd61f193a557 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:09:16.991411 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ff0db4dd-e050-46dd-aa21-fd61f193a557 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:09:16.997810 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ff0db4dd-e050-46dd-aa21-fd61f193a557 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:16.998389 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ff0db4dd-e050-46dd-aa21-fd61f193a557 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:16.999159 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ff0db4dd-e050-46dd-aa21-fd61f193a557 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:16.999596 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ff0db4dd-e050-46dd-aa21-fd61f193a557 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:17.140171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ff0db4dd-e050-46dd-aa21-fd61f193a557 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:09:17.148845 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ff0db4dd-e050-46dd-aa21-fd61f193a557 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1452 microversion: 2.1 time: 0.162375 Jul 21 18:09:17.149510 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 781/1547] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:09:16 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:09:19.617956 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-8aafa8f4-e91a-4ba4-87a2-32a42f663a31 req-755aaaa7-7cae-41b2-9628-c5dcd09b5de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3032f69c-16ce-43d7-8d6c-38275854c874", "tag": "288ab40e-838d-4925-87e6-b371de73f01a"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:09:19.633984 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8aafa8f4-e91a-4ba4-87a2-32a42f663a31 req-755aaaa7-7cae-41b2-9628-c5dcd09b5de5 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:09:19.634778 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8aafa8f4-e91a-4ba4-87a2-32a42f663a31 req-755aaaa7-7cae-41b2-9628-c5dcd09b5de5 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:09:19.650198 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-8aafa8f4-e91a-4ba4-87a2-32a42f663a31 req-755aaaa7-7cae-41b2-9628-c5dcd09b5de5 service nova] Creating event network-changed:288ab40e-838d-4925-87e6-b371de73f01a for instance 3032f69c-16ce-43d7-8d6c-38275854c874 on hv-cinder-82549 Jul 21 18:09:19.656820 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-8aafa8f4-e91a-4ba4-87a2-32a42f663a31 req-755aaaa7-7cae-41b2-9628-c5dcd09b5de5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189471 Jul 21 18:09:19.662920 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 767/1548] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:11:14.310299 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b71c6463-130e-4aa5-9606-3f6bbe5d89f7] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 21 18:11:14.311228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=22 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:14.311969 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=42 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:14.316578 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1588533965", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "networks": [{"uuid": "81a6bdd5-0062-4c7b-b705-3857e8b34008"}]}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:14.368735 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.network.neutron [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] validate_networks() for [('81a6bdd5-0062-4c7b-b705-3857e8b34008', None, None, None, None, None)] {{(pid=124381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 18:11:14.713551 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Flavor limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 18:11:14.714004 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Image limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 18:11:14.714476 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Flavor pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 18:11:14.714882 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Image pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 18:11:14.715291 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 18:11:14.727444 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:14.727826 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:14.728639 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:14.729077 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:14.745152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Getting quotas for project 7a1469ed86624fbe90592a6ded1740ad. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:11:14.749046 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Getting quotas for user 1f2ac51306654b26ad063a6f559f3bfb and project 7a1469ed86624fbe90592a6ded1740ad. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:11:14.760610 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Going to run 1 instances... {{(pid=124381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 18:11:14.762803 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 18:11:14.804763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [36d1f0f5-1091-48f0-b029-1bd6d7175179] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 18:11:15.318724 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] [b71c6463-130e-4aa5-9606-3f6bbe5d89f7] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 47602. Jul 21 18:11:15.812200 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [36d1f0f5-1091-48f0-b029-1bd6d7175179] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 47606. Jul 21 18:11:15.815944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c6eab329-1326-4f9c-8301-40e8b66e5ebf tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.507744 Jul 21 18:11:15.816612 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 782/1549] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 18:11:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 18:11:15.825424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [-] [769f48e3-05be-4b42-ac4d-f350afc85548] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 18:11:15.826034 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:15.826776 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=70 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:15.831504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fa29003e-9cef-433a-be04-ba05716b948e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:15.832622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fa29003e-9cef-433a-be04-ba05716b948e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:15.886824 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fa29003e-9cef-433a-be04-ba05716b948e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:15.893569 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fa29003e-9cef-433a-be04-ba05716b948e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1214 microversion: 2.1 time: 0.070078 Jul 21 18:11:15.894136 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 768/1550] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:15 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:16.911423 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-eddb8fb5-34fd-437d-816a-c2e8ce6d792e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:16.912144 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-eddb8fb5-34fd-437d-816a-c2e8ce6d792e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:16.964867 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-eddb8fb5-34fd-437d-816a-c2e8ce6d792e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:16.972112 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-eddb8fb5-34fd-437d-816a-c2e8ce6d792e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1214 microversion: 2.1 time: 0.065519 Jul 21 18:11:16.972710 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 783/1551] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:16 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:17.989762 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4f843590-f483-4555-be64-1b03d04e21ee tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:17.990388 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4f843590-f483-4555-be64-1b03d04e21ee tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:18.015393 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] [769f48e3-05be-4b42-ac4d-f350afc85548] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 47630. Jul 21 18:11:18.053772 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4f843590-f483-4555-be64-1b03d04e21ee tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:18.061170 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4f843590-f483-4555-be64-1b03d04e21ee tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1214 microversion: 2.1 time: 0.075563 Jul 21 18:11:18.061730 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 769/1552] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:17 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:19.078051 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b6ed96c7-44a4-4a74-b73c-72e235bcbf58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:19.078664 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b6ed96c7-44a4-4a74-b73c-72e235bcbf58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:19.133416 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b6ed96c7-44a4-4a74-b73c-72e235bcbf58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:19.140504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b6ed96c7-44a4-4a74-b73c-72e235bcbf58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1214 microversion: 2.1 time: 0.066121 Jul 21 18:11:19.141072 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 784/1553] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:19 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:20.158501 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-82268b8d-e37b-42f4-aa33-7ded628574cd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:20.159123 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-82268b8d-e37b-42f4-aa33-7ded628574cd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:20.167162 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82268b8d-e37b-42f4-aa33-7ded628574cd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:20.167612 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82268b8d-e37b-42f4-aa33-7ded628574cd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:20.168413 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82268b8d-e37b-42f4-aa33-7ded628574cd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:20.168846 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82268b8d-e37b-42f4-aa33-7ded628574cd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:20.230293 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-82268b8d-e37b-42f4-aa33-7ded628574cd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:20.237852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-82268b8d-e37b-42f4-aa33-7ded628574cd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1218 microversion: 2.1 time: 0.083190 Jul 21 18:11:20.238421 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 770/1554] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:20 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:21.255326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-add92924-562b-4808-8173-9b3cdcbc7b08 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:21.255945 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-add92924-562b-4808-8173-9b3cdcbc7b08 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:21.263237 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-add92924-562b-4808-8173-9b3cdcbc7b08 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:21.263681 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-add92924-562b-4808-8173-9b3cdcbc7b08 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:21.264479 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-add92924-562b-4808-8173-9b3cdcbc7b08 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:21.264916 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-add92924-562b-4808-8173-9b3cdcbc7b08 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:21.326880 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-add92924-562b-4808-8173-9b3cdcbc7b08 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:21.334353 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-add92924-562b-4808-8173-9b3cdcbc7b08 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1272 microversion: 2.1 time: 0.083229 Jul 21 18:11:21.334913 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 785/1555] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:21 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:22.136399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-9baf638d-d0ca-4db0-a36e-41742ac1b671 req-4408f841-3746-4001-b299-8d23d6e063e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04163dd8-a269-4609-bec2-d05542c17aa7", "tag": "e4fd7ff6-66ec-4427-8199-c83c8c05a9d8"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:22.146622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-9baf638d-d0ca-4db0-a36e-41742ac1b671 req-4408f841-3746-4001-b299-8d23d6e063e3 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:22.147277 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-9baf638d-d0ca-4db0-a36e-41742ac1b671 req-4408f841-3746-4001-b299-8d23d6e063e3 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:22.160502 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-9baf638d-d0ca-4db0-a36e-41742ac1b671 req-4408f841-3746-4001-b299-8d23d6e063e3 service nova] Creating event network-changed:e4fd7ff6-66ec-4427-8199-c83c8c05a9d8 for instance 04163dd8-a269-4609-bec2-d05542c17aa7 on hv-cinder-82549 Jul 21 18:11:22.166163 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-9baf638d-d0ca-4db0-a36e-41742ac1b671 req-4408f841-3746-4001-b299-8d23d6e063e3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033703 Jul 21 18:11:22.166928 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 771/1556] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:11:22.350871 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ae731e86-aae5-4f5a-af51-fd3a09acad09 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:22.351490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ae731e86-aae5-4f5a-af51-fd3a09acad09 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:22.358000 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae731e86-aae5-4f5a-af51-fd3a09acad09 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:22.358451 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae731e86-aae5-4f5a-af51-fd3a09acad09 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:22.359224 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae731e86-aae5-4f5a-af51-fd3a09acad09 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:22.359661 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ae731e86-aae5-4f5a-af51-fd3a09acad09 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:22.496095 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ae731e86-aae5-4f5a-af51-fd3a09acad09 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:22.503629 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ae731e86-aae5-4f5a-af51-fd3a09acad09 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1314 microversion: 2.1 time: 0.156608 Jul 21 18:11:22.504197 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 786/1557] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:22 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:23.522651 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7d76b25c-c1ee-4c98-bbd0-795a5d0f2c8c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:23.523370 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7d76b25c-c1ee-4c98-bbd0-795a5d0f2c8c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:23.529907 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d76b25c-c1ee-4c98-bbd0-795a5d0f2c8c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:23.530359 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d76b25c-c1ee-4c98-bbd0-795a5d0f2c8c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:23.531132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d76b25c-c1ee-4c98-bbd0-795a5d0f2c8c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:23.531578 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d76b25c-c1ee-4c98-bbd0-795a5d0f2c8c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:23.667123 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7d76b25c-c1ee-4c98-bbd0-795a5d0f2c8c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:23.674966 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7d76b25c-c1ee-4c98-bbd0-795a5d0f2c8c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1314 microversion: 2.1 time: 0.157698 Jul 21 18:11:23.675529 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 772/1558] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:23 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:24.691370 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bce64d09-28f8-469c-9b3a-cafb791dbd3b tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:24.692063 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bce64d09-28f8-469c-9b3a-cafb791dbd3b tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:24.698649 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bce64d09-28f8-469c-9b3a-cafb791dbd3b tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:24.699095 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bce64d09-28f8-469c-9b3a-cafb791dbd3b tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:24.699892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bce64d09-28f8-469c-9b3a-cafb791dbd3b tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:24.700352 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bce64d09-28f8-469c-9b3a-cafb791dbd3b tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:24.736651 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:24.830817 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-bce64d09-28f8-469c-9b3a-cafb791dbd3b tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:24.839545 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bce64d09-28f8-469c-9b3a-cafb791dbd3b tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1314 microversion: 2.1 time: 0.151988 Jul 21 18:11:24.840120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 787/1559] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:24 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:25.856950 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-500e878a-d008-41ba-a526-c8f39ddea079 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:25.857592 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-500e878a-d008-41ba-a526-c8f39ddea079 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:25.864909 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-500e878a-d008-41ba-a526-c8f39ddea079 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:25.865354 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-500e878a-d008-41ba-a526-c8f39ddea079 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:25.866123 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-500e878a-d008-41ba-a526-c8f39ddea079 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:25.866554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-500e878a-d008-41ba-a526-c8f39ddea079 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:25.996746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-500e878a-d008-41ba-a526-c8f39ddea079 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:26.004152 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-500e878a-d008-41ba-a526-c8f39ddea079 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1314 microversion: 2.1 time: 0.151054 Jul 21 18:11:26.005335 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 773/1560] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:25 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:27.022112 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6532d74d-f516-463d-8cd5-fb81b77a4d58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:27.022727 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6532d74d-f516-463d-8cd5-fb81b77a4d58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:27.029242 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6532d74d-f516-463d-8cd5-fb81b77a4d58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:27.029690 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6532d74d-f516-463d-8cd5-fb81b77a4d58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:27.030448 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6532d74d-f516-463d-8cd5-fb81b77a4d58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:27.030888 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6532d74d-f516-463d-8cd5-fb81b77a4d58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:27.160043 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6532d74d-f516-463d-8cd5-fb81b77a4d58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:27.168013 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6532d74d-f516-463d-8cd5-fb81b77a4d58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1314 microversion: 2.1 time: 0.150380 Jul 21 18:11:27.168608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 788/1561] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:27 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:27.377519 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-31cc7f4f-3372-4a16-b10c-8929cc5a17fe req-2a8d4ba0-a1b3-447d-97ec-56753af6c427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04163dd8-a269-4609-bec2-d05542c17aa7", "name": "network-vif-plugged", "status": "completed", "tag": "e4fd7ff6-66ec-4427-8199-c83c8c05a9d8"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:27.386810 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-31cc7f4f-3372-4a16-b10c-8929cc5a17fe req-2a8d4ba0-a1b3-447d-97ec-56753af6c427 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:27.387374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-31cc7f4f-3372-4a16-b10c-8929cc5a17fe req-2a8d4ba0-a1b3-447d-97ec-56753af6c427 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:27.399399 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-31cc7f4f-3372-4a16-b10c-8929cc5a17fe req-2a8d4ba0-a1b3-447d-97ec-56753af6c427 service nova] Creating event network-vif-plugged:e4fd7ff6-66ec-4427-8199-c83c8c05a9d8 for instance 04163dd8-a269-4609-bec2-d05542c17aa7 on hv-cinder-82549 Jul 21 18:11:27.404353 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-31cc7f4f-3372-4a16-b10c-8929cc5a17fe req-2a8d4ba0-a1b3-447d-97ec-56753af6c427 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030478 Jul 21 18:11:27.405113 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 774/1562] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:11:27.665492 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-68a1a7f7-4b9e-4ab6-814b-46c2f3c35d45 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:27.665996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-68a1a7f7-4b9e-4ab6-814b-46c2f3c35d45 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:27.671944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-68a1a7f7-4b9e-4ab6-814b-46c2f3c35d45 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:27.672429 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-68a1a7f7-4b9e-4ab6-814b-46c2f3c35d45 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:27.673196 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-68a1a7f7-4b9e-4ab6-814b-46c2f3c35d45 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:27.673889 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-68a1a7f7-4b9e-4ab6-814b-46c2f3c35d45 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:27.699394 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-68a1a7f7-4b9e-4ab6-814b-46c2f3c35d45 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Going to try to terminate instance {{(pid=124381) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 18:11:27.773755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-68a1a7f7-4b9e-4ab6-814b-46c2f3c35d45 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 204 len: 0 microversion: 2.1 time: 0.111870 Jul 21 18:11:27.774332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 789/1563] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:11:27 2022] DELETE /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 18:11:27.782935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-389b4cf2-db7c-487a-a02c-d229704cc771 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:27.783630 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-389b4cf2-db7c-487a-a02c-d229704cc771 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:27.790112 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-389b4cf2-db7c-487a-a02c-d229704cc771 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:27.790557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-389b4cf2-db7c-487a-a02c-d229704cc771 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:27.791316 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-389b4cf2-db7c-487a-a02c-d229704cc771 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:27.791748 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-389b4cf2-db7c-487a-a02c-d229704cc771 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:27.926802 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-389b4cf2-db7c-487a-a02c-d229704cc771 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:27.936242 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-389b4cf2-db7c-487a-a02c-d229704cc771 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1576 microversion: 2.1 time: 0.157019 Jul 21 18:11:27.936469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 775/1564] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:27 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:11:28.185488 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4e6007a8-ccc2-43c2-a7d3-c980857ea318 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:28.186103 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4e6007a8-ccc2-43c2-a7d3-c980857ea318 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:28.192608 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4e6007a8-ccc2-43c2-a7d3-c980857ea318 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:28.193052 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4e6007a8-ccc2-43c2-a7d3-c980857ea318 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:28.193810 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4e6007a8-ccc2-43c2-a7d3-c980857ea318 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:28.194239 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4e6007a8-ccc2-43c2-a7d3-c980857ea318 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:28.321763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4e6007a8-ccc2-43c2-a7d3-c980857ea318 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:28.329116 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4e6007a8-ccc2-43c2-a7d3-c980857ea318 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1314 microversion: 2.1 time: 0.147877 Jul 21 18:11:28.329674 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 790/1565] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:28 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:28.954191 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cd74c7e3-f46e-43ba-b4e4-de520a513527 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:28.954851 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cd74c7e3-f46e-43ba-b4e4-de520a513527 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:28.956820 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:28.962711 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd74c7e3-f46e-43ba-b4e4-de520a513527 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:28.963166 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd74c7e3-f46e-43ba-b4e4-de520a513527 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:28.963932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd74c7e3-f46e-43ba-b4e4-de520a513527 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:28.964403 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd74c7e3-f46e-43ba-b4e4-de520a513527 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:29.100428 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cd74c7e3-f46e-43ba-b4e4-de520a513527 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:29.107836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cd74c7e3-f46e-43ba-b4e4-de520a513527 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1576 microversion: 2.1 time: 0.157480 Jul 21 18:11:29.108419 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 776/1566] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:28 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:29.346750 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1787f767-8993-4589-900a-78df044634ff tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:29.347347 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1787f767-8993-4589-900a-78df044634ff tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:29.349917 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=10 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:29.355494 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1787f767-8993-4589-900a-78df044634ff tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:29.355939 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1787f767-8993-4589-900a-78df044634ff tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:29.356728 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1787f767-8993-4589-900a-78df044634ff tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:29.357163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1787f767-8993-4589-900a-78df044634ff tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:29.485571 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1787f767-8993-4589-900a-78df044634ff tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:29.492933 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1787f767-8993-4589-900a-78df044634ff tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1314 microversion: 2.1 time: 0.150106 Jul 21 18:11:29.493505 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 791/1567] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:29 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:30.124823 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a9a2305f-6158-4a83-85cd-c8ae861d800c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:30.125431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a9a2305f-6158-4a83-85cd-c8ae861d800c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:30.132024 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9a2305f-6158-4a83-85cd-c8ae861d800c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:30.132519 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9a2305f-6158-4a83-85cd-c8ae861d800c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:30.133279 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9a2305f-6158-4a83-85cd-c8ae861d800c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:30.133716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9a2305f-6158-4a83-85cd-c8ae861d800c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:30.267926 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a9a2305f-6158-4a83-85cd-c8ae861d800c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:30.275818 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a9a2305f-6158-4a83-85cd-c8ae861d800c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1576 microversion: 2.1 time: 0.154816 Jul 21 18:11:30.276404 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 777/1568] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:30 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:30.510222 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e20beed2-ec43-46b4-912c-c8cbfb6e15ad tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:30.510818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e20beed2-ec43-46b4-912c-c8cbfb6e15ad tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:30.517391 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e20beed2-ec43-46b4-912c-c8cbfb6e15ad tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:30.517836 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e20beed2-ec43-46b4-912c-c8cbfb6e15ad tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:30.518599 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e20beed2-ec43-46b4-912c-c8cbfb6e15ad tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:30.519036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e20beed2-ec43-46b4-912c-c8cbfb6e15ad tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:30.652246 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e20beed2-ec43-46b4-912c-c8cbfb6e15ad tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:30.659598 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e20beed2-ec43-46b4-912c-c8cbfb6e15ad tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1499 microversion: 2.1 time: 0.153153 Jul 21 18:11:30.660162 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 792/1569] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:30 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1499 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:31.117281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-30295f9e-a3be-4a46-adc1-083623d6de33 req-dd02ac43-b2be-4cd2-bbcb-7a086fc2e395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3032f69c-16ce-43d7-8d6c-38275854c874", "name": "network-vif-deleted", "tag": "288ab40e-838d-4925-87e6-b371de73f01a"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:31.126341 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-30295f9e-a3be-4a46-adc1-083623d6de33 req-dd02ac43-b2be-4cd2-bbcb-7a086fc2e395 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:31.126994 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-30295f9e-a3be-4a46-adc1-083623d6de33 req-dd02ac43-b2be-4cd2-bbcb-7a086fc2e395 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:31.144047 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-30295f9e-a3be-4a46-adc1-083623d6de33 req-dd02ac43-b2be-4cd2-bbcb-7a086fc2e395 service nova] Creating event network-vif-deleted:288ab40e-838d-4925-87e6-b371de73f01a for instance 3032f69c-16ce-43d7-8d6c-38275854c874 on hv-cinder-82549 Jul 21 18:11:31.149340 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5f4cf501-928e-4399-b71d-1afd9a77dc52 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:31.150082 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-30295f9e-a3be-4a46-adc1-083623d6de33 req-dd02ac43-b2be-4cd2-bbcb-7a086fc2e395 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036719 Jul 21 18:11:31.151049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 778/1570] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:11:31.151470 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5f4cf501-928e-4399-b71d-1afd9a77dc52 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:31.161040 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5f4cf501-928e-4399-b71d-1afd9a77dc52 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:31.161768 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5f4cf501-928e-4399-b71d-1afd9a77dc52 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:31.162816 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5f4cf501-928e-4399-b71d-1afd9a77dc52 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:31.163432 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5f4cf501-928e-4399-b71d-1afd9a77dc52 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:31.205348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5f4cf501-928e-4399-b71d-1afd9a77dc52 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Going to try to terminate instance {{(pid=124381) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 18:11:31.295736 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-81054502-c4ef-409b-a11c-a5c2e1911a8a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:31.297568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-81054502-c4ef-409b-a11c-a5c2e1911a8a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:31.305277 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5f4cf501-928e-4399-b71d-1afd9a77dc52 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "DELETE /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 204 len: 0 microversion: 2.1 time: 0.162680 Jul 21 18:11:31.305986 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 793/1571] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:11:31 2022] DELETE /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 18:11:31.309631 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81054502-c4ef-409b-a11c-a5c2e1911a8a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:31.310220 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81054502-c4ef-409b-a11c-a5c2e1911a8a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:31.311132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81054502-c4ef-409b-a11c-a5c2e1911a8a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:31.311648 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81054502-c4ef-409b-a11c-a5c2e1911a8a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:31.315748 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c55bdbb7-e537-4bc1-b23c-22a9c8e5e856 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:31.317132 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c55bdbb7-e537-4bc1-b23c-22a9c8e5e856 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:31.325556 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c55bdbb7-e537-4bc1-b23c-22a9c8e5e856 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:31.326309 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c55bdbb7-e537-4bc1-b23c-22a9c8e5e856 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:31.327479 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c55bdbb7-e537-4bc1-b23c-22a9c8e5e856 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:31.328161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c55bdbb7-e537-4bc1-b23c-22a9c8e5e856 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:31.431122 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-81054502-c4ef-409b-a11c-a5c2e1911a8a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:31.439997 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-81054502-c4ef-409b-a11c-a5c2e1911a8a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1226 microversion: 2.1 time: 0.150440 Jul 21 18:11:31.440818 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 779/1572] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:31 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1226 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:31.516832 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c55bdbb7-e537-4bc1-b23c-22a9c8e5e856 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:31.526495 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c55bdbb7-e537-4bc1-b23c-22a9c8e5e856 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1505 microversion: 2.1 time: 0.215796 Jul 21 18:11:31.536985 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 794/1573] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:31 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:11:32.458565 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8407e0ee-e71b-4a8c-82b2-922e97a57302 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:32.459111 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8407e0ee-e71b-4a8c-82b2-922e97a57302 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:32.465653 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8407e0ee-e71b-4a8c-82b2-922e97a57302 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:32.466107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8407e0ee-e71b-4a8c-82b2-922e97a57302 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:32.466875 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8407e0ee-e71b-4a8c-82b2-922e97a57302 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:32.467314 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8407e0ee-e71b-4a8c-82b2-922e97a57302 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:32.497672 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8407e0ee-e71b-4a8c-82b2-922e97a57302 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:32.498125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8407e0ee-e71b-4a8c-82b2-922e97a57302 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:32.498580 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-8407e0ee-e71b-4a8c-82b2-922e97a57302 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lazy-loading 'fault' on Instance uuid 3032f69c-16ce-43d7-8d6c-38275854c874 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 18:11:32.541882 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8407e0ee-e71b-4a8c-82b2-922e97a57302 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:32.545018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-52e0d33a-d6c8-447e-b437-088dc0779f9e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:32.546177 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-52e0d33a-d6c8-447e-b437-088dc0779f9e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:32.550150 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8407e0ee-e71b-4a8c-82b2-922e97a57302 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 200 len: 1231 microversion: 2.1 time: 0.096606 Jul 21 18:11:32.550729 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 780/1574] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:32 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:32.553610 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52e0d33a-d6c8-447e-b437-088dc0779f9e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:32.554060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52e0d33a-d6c8-447e-b437-088dc0779f9e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:32.554919 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52e0d33a-d6c8-447e-b437-088dc0779f9e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:32.555423 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-52e0d33a-d6c8-447e-b437-088dc0779f9e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:32.685185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-52e0d33a-d6c8-447e-b437-088dc0779f9e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:32.693009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-52e0d33a-d6c8-447e-b437-088dc0779f9e tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1505 microversion: 2.1 time: 0.151953 Jul 21 18:11:32.693576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 795/1575] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:32 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:33.337216 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-a38bb5b6-53d6-49bb-9ea8-abd67cd5a97c req-687f309c-d824-4651-a0a9-68a177d3276c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04163dd8-a269-4609-bec2-d05542c17aa7", "name": "network-vif-deleted", "tag": "e4fd7ff6-66ec-4427-8199-c83c8c05a9d8"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:33.346232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-a38bb5b6-53d6-49bb-9ea8-abd67cd5a97c req-687f309c-d824-4651-a0a9-68a177d3276c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:33.347736 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-a38bb5b6-53d6-49bb-9ea8-abd67cd5a97c req-687f309c-d824-4651-a0a9-68a177d3276c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:33.360685 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-a38bb5b6-53d6-49bb-9ea8-abd67cd5a97c req-687f309c-d824-4651-a0a9-68a177d3276c service nova] Creating event network-vif-deleted:e4fd7ff6-66ec-4427-8199-c83c8c05a9d8 for instance 04163dd8-a269-4609-bec2-d05542c17aa7 on hv-cinder-82549 Jul 21 18:11:33.366501 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-a38bb5b6-53d6-49bb-9ea8-abd67cd5a97c req-687f309c-d824-4651-a0a9-68a177d3276c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033000 Jul 21 18:11:33.367464 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 781/1576] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:11:33.567035 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-61d8e292-e4e8-4576-933a-e20351709926 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:33.567590 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-61d8e292-e4e8-4576-933a-e20351709926 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:33.575067 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-61d8e292-e4e8-4576-933a-e20351709926 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:33.575515 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-61d8e292-e4e8-4576-933a-e20351709926 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:33.576278 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-61d8e292-e4e8-4576-933a-e20351709926 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:33.576742 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-61d8e292-e4e8-4576-933a-e20351709926 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:33.712902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3b55dad1-9df0-4ebb-b8bb-dc6ce8b1f01f tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:33.713623 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3b55dad1-9df0-4ebb-b8bb-dc6ce8b1f01f tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:33.720274 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b55dad1-9df0-4ebb-b8bb-dc6ce8b1f01f tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:33.720752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b55dad1-9df0-4ebb-b8bb-dc6ce8b1f01f tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:33.721531 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b55dad1-9df0-4ebb-b8bb-dc6ce8b1f01f tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:33.722133 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b55dad1-9df0-4ebb-b8bb-dc6ce8b1f01f tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:33.748854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-61d8e292-e4e8-4576-933a-e20351709926 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] HTTP exception thrown: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-61d8e292-e4e8-4576-933a-e20351709926 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Request method failure captured: Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 HTTP/1.1 Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2ZYfle9wcKqdyHo9Z87EEBVjSkcCvWGEryIP-od2IVGjfqi394VJgIoLVZtPGAUr5iReDTJgUJ93sD3Cq0QGNM41ToZwtD5K24kqo6fDnn2dBfsT8hK4l_6ek81IPHvsXhgGffps8yp_eZ9AcwhJdf7lsEcYagjqY6mwOMg7CNNLOms Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 076a5b3e4cd141b9bd9ef199e0fa0ba1 Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:11:33.750507 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:11:33.751692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_076a5b3e4cd141b9bd9ef199e0fa0ba1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}] Jul 21 18:11:33.751692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:11:33.751692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 076a5b3e4cd141b9bd9ef199e0fa0ba1 Jul 21 18:11:33.751692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:11:33.751692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-TestVolumeBootPattern-1059967138-project Jul 21 18:11:33.751692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:11:33.751692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:11:33.751692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 293d4ca894e24e4fb6c4e7aa14256d78 Jul 21 18:11:33.751692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-TestVolumeBootPattern-1059967138-project Jul 21 18:11:33.751692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:11:33.751692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:11:33.751692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '3032f69c-16ce-43d7-8d6c-38275854c874'} Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:11:33.752392 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:11:33.753453 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:33.754348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-61d8e292-e4e8-4576-933a-e20351709926 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Returning 404 to user: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:11:33.754348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-61d8e292-e4e8-4576-933a-e20351709926 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 404 len: 111 microversion: 2.1 time: 0.188833 Jul 21 18:11:33.754348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 796/1577] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:33 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:11:33.757449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b55dad1-9df0-4ebb-b8bb-dc6ce8b1f01f tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:33.757945 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b55dad1-9df0-4ebb-b8bb-dc6ce8b1f01f tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:33.758626 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-3b55dad1-9df0-4ebb-b8bb-dc6ce8b1f01f tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lazy-loading 'fault' on Instance uuid 04163dd8-a269-4609-bec2-d05542c17aa7 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 18:11:33.806707 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3b55dad1-9df0-4ebb-b8bb-dc6ce8b1f01f tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:33.816481 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3b55dad1-9df0-4ebb-b8bb-dc6ce8b1f01f tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 200 len: 1304 microversion: 2.1 time: 0.109895 Jul 21 18:11:33.817121 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 782/1578] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:33 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:11:33.859662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-509247725", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1392459256", "security_groups": [{"name": "tempest-secgroup-smoke-670077957"}], "block_device_mapping_v2": [{"uuid": "e571a310-9f0b-4aa3-9f65-3b01fd072f8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0e284ef-40f5-48ad-ba5a-1c18c4604cd6"}]}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:33.982251 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.network.neutron [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] validate_networks() for [('b0e284ef-40f5-48ad-ba5a-1c18c4604cd6', None, None, None, None, None)] {{(pid=124381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 18:11:34.353912 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Flavor limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 18:11:34.354331 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Image limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 18:11:34.354799 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Flavor pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 18:11:34.355202 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Image pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 18:11:34.355611 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 18:11:34.364307 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:34.364835 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:34.365776 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:34.366205 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:34.382696 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Getting quotas for project 076a5b3e4cd141b9bd9ef199e0fa0ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:11:34.386538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Getting quotas for user 293d4ca894e24e4fb6c4e7aa14256d78 and project 076a5b3e4cd141b9bd9ef199e0fa0ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:11:34.444047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Going to run 1 instances... {{(pid=124381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 18:11:34.446164 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e571a310-9f0b-4aa3-9f65-3b01fd072f8c',volume_size=None,volume_type=None)] {{(pid=124381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 18:11:34.573127 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-59f6c6b1-621f-4fed-bf37-28d21d2dbb7a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.717537 Jul 21 18:11:34.573760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 797/1579] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 18:11:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 18:11:34.583760 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-16f5d11a-4110-48db-8047-5cf932ea7c2c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:34.584408 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-16f5d11a-4110-48db-8047-5cf932ea7c2c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:34.636983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-16f5d11a-4110-48db-8047-5cf932ea7c2c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:34.644469 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-16f5d11a-4110-48db-8047-5cf932ea7c2c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1094 microversion: 2.1 time: 0.064650 Jul 21 18:11:34.645043 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 783/1580] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:34 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:34.834398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5a3a7835-6b9e-4936-a71f-d5fb465f80e0 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:34.835003 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5a3a7835-6b9e-4936-a71f-d5fb465f80e0 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 04163dd8-a269-4609-bec2-d05542c17aa7] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:34.841215 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a3a7835-6b9e-4936-a71f-d5fb465f80e0 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:34.841946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a3a7835-6b9e-4936-a71f-d5fb465f80e0 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:34.842702 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a3a7835-6b9e-4936-a71f-d5fb465f80e0 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:34.843140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a3a7835-6b9e-4936-a71f-d5fb465f80e0 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:34.856800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-5a3a7835-6b9e-4936-a71f-d5fb465f80e0 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] HTTP exception thrown: Instance 04163dd8-a269-4609-bec2-d05542c17aa7 could not be found. Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5a3a7835-6b9e-4936-a71f-d5fb465f80e0 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Request method failure captured: Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 HTTP/1.1 Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2ZbAgFVGkge8Xktze39YMoMec9DusV33a2vlgv3DGpwFipQ4rCsukCFCfbmbXWeEaVmdLr7UYsvw02XZILIP2ONw9k6Lr5-Rst6qZTlIxT_ct2shL_jqErGyq4G4vZK36zJEGheiWaHa7UAkcOm13_EWscxMIHhMzSjT-KiV0Fe4380 Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 7a1469ed86624fbe90592a6ded1740ad Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-VolumesActionsTest-2051101126 Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:11:34.858462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:11:34.859841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7a1469ed86624fbe90592a6ded1740ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7a1469ed86624fbe90592a6ded1740ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7a1469ed86624fbe90592a6ded1740ad", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7a1469ed86624fbe90592a6ded1740ad"}]}] Jul 21 18:11:34.859841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-VolumesActionsTest-2051101126 Jul 21 18:11:34.859841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 7a1469ed86624fbe90592a6ded1740ad Jul 21 18:11:34.859841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-VolumesActionsTest-2051101126 Jul 21 18:11:34.859841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-VolumesActionsTest-2051101126-project Jul 21 18:11:34.859841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:11:34.859841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:11:34.859841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 1f2ac51306654b26ad063a6f559f3bfb Jul 21 18:11:34.859841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-VolumesActionsTest-2051101126-project Jul 21 18:11:34.859841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:11:34.859841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 04163dd8-a269-4609-bec2-d05542c17aa7 could not be found. Jul 21 18:11:34.859841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '04163dd8-a269-4609-bec2-d05542c17aa7'} Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04163dd8-a269-4609-bec2-d05542c17aa7 could not be found. Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:11:34.860566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04163dd8-a269-4609-bec2-d05542c17aa7 could not be found. Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04163dd8-a269-4609-bec2-d05542c17aa7 could not be found. Jul 21 18:11:34.861694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:34.862766 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5a3a7835-6b9e-4936-a71f-d5fb465f80e0 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Returning 404 to user: Instance 04163dd8-a269-4609-bec2-d05542c17aa7 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:11:34.862766 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5a3a7835-6b9e-4936-a71f-d5fb465f80e0 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7" status: 404 len: 111 microversion: 2.1 time: 0.029730 Jul 21 18:11:34.871629 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 798/1581] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:34 2022] GET /compute/v2.1/servers/04163dd8-a269-4609-bec2-d05542c17aa7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:11:34.914060 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1587014141", "imageRef": "f2ccb870-a8e3-4cba-9a8a-35535c360e88", "flavorRef": "452", "networks": [{"uuid": "81a6bdd5-0062-4c7b-b705-3857e8b34008"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:34.967465 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] validate_networks() for [('81a6bdd5-0062-4c7b-b705-3857e8b34008', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 18:11:35.433313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 18:11:35.433746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 18:11:35.434220 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 18:11:35.434628 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 18:11:35.435043 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 18:11:35.443828 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:35.444269 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:35.445093 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:35.445524 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:35.462626 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Getting quotas for project 7a1469ed86624fbe90592a6ded1740ad. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:11:35.466557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Getting quotas for user 1f2ac51306654b26ad063a6f559f3bfb and project 7a1469ed86624fbe90592a6ded1740ad. Resources: {'ram', 'instances', 'cores'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:11:35.479085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 18:11:35.481356 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f2ccb870-a8e3-4cba-9a8a-35535c360e88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 18:11:35.529180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [df4c8137-8d93-4049-94d8-9c32f123599f] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 18:11:35.661115 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-083313a1-7eee-4915-9d89-ca1d874a3830 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:35.662405 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-083313a1-7eee-4915-9d89-ca1d874a3830 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:35.668824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-083313a1-7eee-4915-9d89-ca1d874a3830 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:35.669271 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-083313a1-7eee-4915-9d89-ca1d874a3830 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:35.670039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-083313a1-7eee-4915-9d89-ca1d874a3830 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:35.670480 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-083313a1-7eee-4915-9d89-ca1d874a3830 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:35.737120 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-083313a1-7eee-4915-9d89-ca1d874a3830 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:35.742362 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:35.749963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-083313a1-7eee-4915-9d89-ca1d874a3830 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1210 microversion: 2.1 time: 0.092146 Jul 21 18:11:35.750733 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 799/1582] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:35 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:11:35.874857 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 18:11:35.875147 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 18:11:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.57) !!! Jul 21 18:11:36.539223 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [df4c8137-8d93-4049-94d8-9c32f123599f] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 47778. Jul 21 18:11:36.552974 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-011f3034-d8e4-4280-86b4-f9642dc39985 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.643485 Jul 21 18:11:36.553629 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 784/1583] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 18:11:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 18:11:36.563913 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-22710e64-32c5-4080-b7a6-e5049c778957 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:36.565703 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-22710e64-32c5-4080-b7a6-e5049c778957 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:36.653501 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-22710e64-32c5-4080-b7a6-e5049c778957 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:36.662342 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-22710e64-32c5-4080-b7a6-e5049c778957 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1214 microversion: 2.1 time: 0.102495 Jul 21 18:11:36.663308 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 800/1584] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:36 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:36.768632 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c404313a-94b6-4f40-a401-df829062b5fc tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:36.769255 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c404313a-94b6-4f40-a401-df829062b5fc tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:36.778073 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c404313a-94b6-4f40-a401-df829062b5fc tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:36.778744 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c404313a-94b6-4f40-a401-df829062b5fc tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:36.779655 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c404313a-94b6-4f40-a401-df829062b5fc tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:36.780328 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c404313a-94b6-4f40-a401-df829062b5fc tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:36.931959 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c404313a-94b6-4f40-a401-df829062b5fc tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:36.944559 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c404313a-94b6-4f40-a401-df829062b5fc tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1265 microversion: 2.1 time: 0.179482 Jul 21 18:11:36.945541 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 785/1585] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:36 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:37.238017 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-0b396337-df0b-448a-bf85-a42aa8bb9bd7 req-f8ce3d95-b8dc-4c7b-91ed-1285c2bf0487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485dc0c9-e504-46b3-89bc-b42497a1eb52", "tag": "0eb22396-58ea-40e2-9e8a-963d0156bc0f"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:37.248339 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-0b396337-df0b-448a-bf85-a42aa8bb9bd7 req-f8ce3d95-b8dc-4c7b-91ed-1285c2bf0487 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:37.251875 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-0b396337-df0b-448a-bf85-a42aa8bb9bd7 req-f8ce3d95-b8dc-4c7b-91ed-1285c2bf0487 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:37.268605 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-0b396337-df0b-448a-bf85-a42aa8bb9bd7 req-f8ce3d95-b8dc-4c7b-91ed-1285c2bf0487 service nova] Creating event network-changed:0eb22396-58ea-40e2-9e8a-963d0156bc0f for instance 485dc0c9-e504-46b3-89bc-b42497a1eb52 on hv-cinder-82549 Jul 21 18:11:37.275376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-0b396337-df0b-448a-bf85-a42aa8bb9bd7 req-f8ce3d95-b8dc-4c7b-91ed-1285c2bf0487 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044579 Jul 21 18:11:37.276432 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 801/1586] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:11:37.680738 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f085f87d-9725-45a9-ba12-02c30f204bc8 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:37.681296 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f085f87d-9725-45a9-ba12-02c30f204bc8 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:37.687366 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f085f87d-9725-45a9-ba12-02c30f204bc8 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:37.687839 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f085f87d-9725-45a9-ba12-02c30f204bc8 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:37.688618 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f085f87d-9725-45a9-ba12-02c30f204bc8 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:37.689063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f085f87d-9725-45a9-ba12-02c30f204bc8 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:37.750318 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f085f87d-9725-45a9-ba12-02c30f204bc8 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:37.757829 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f085f87d-9725-45a9-ba12-02c30f204bc8 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1274 microversion: 2.1 time: 0.082029 Jul 21 18:11:37.758404 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 786/1587] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:37 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:37.961972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d7454d60-b32d-4680-9424-0b766cf7ae3b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:37.962475 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d7454d60-b32d-4680-9424-0b766cf7ae3b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:37.970941 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d7454d60-b32d-4680-9424-0b766cf7ae3b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:37.971400 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d7454d60-b32d-4680-9424-0b766cf7ae3b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:37.972184 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d7454d60-b32d-4680-9424-0b766cf7ae3b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:37.974792 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d7454d60-b32d-4680-9424-0b766cf7ae3b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:38.119087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d7454d60-b32d-4680-9424-0b766cf7ae3b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:38.126563 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d7454d60-b32d-4680-9424-0b766cf7ae3b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1265 microversion: 2.1 time: 0.169432 Jul 21 18:11:38.127175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 802/1588] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:37 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:38.775480 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0e9a89a5-353f-4176-9db1-b31d331c1f04 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:38.776100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0e9a89a5-353f-4176-9db1-b31d331c1f04 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:38.782920 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e9a89a5-353f-4176-9db1-b31d331c1f04 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:38.783372 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e9a89a5-353f-4176-9db1-b31d331c1f04 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:38.784147 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e9a89a5-353f-4176-9db1-b31d331c1f04 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:38.784611 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e9a89a5-353f-4176-9db1-b31d331c1f04 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:38.927841 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0e9a89a5-353f-4176-9db1-b31d331c1f04 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:38.936885 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0e9a89a5-353f-4176-9db1-b31d331c1f04 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1314 microversion: 2.1 time: 0.165827 Jul 21 18:11:38.938100 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 787/1589] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:38 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:39.143478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3abc6da2-b96a-4101-ab25-c7320c4a6b92 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:39.144097 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3abc6da2-b96a-4101-ab25-c7320c4a6b92 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:39.150934 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3abc6da2-b96a-4101-ab25-c7320c4a6b92 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:39.151384 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3abc6da2-b96a-4101-ab25-c7320c4a6b92 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:39.152159 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3abc6da2-b96a-4101-ab25-c7320c4a6b92 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:39.152635 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3abc6da2-b96a-4101-ab25-c7320c4a6b92 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:39.285010 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3abc6da2-b96a-4101-ab25-c7320c4a6b92 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:39.292621 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3abc6da2-b96a-4101-ab25-c7320c4a6b92 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1265 microversion: 2.1 time: 0.152944 Jul 21 18:11:39.293290 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 803/1590] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:39 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:39.845021 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-22dbb181-acbb-45e0-bad4-077518ff0565 req-84103f9b-4fb1-4805-9c8e-a018b8bbcd6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d55f00a-823c-4f6e-9370-fbd72ea8eded", "tag": "814d5514-4b18-40e1-af9a-78ad704e9cac"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:39.857017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-22dbb181-acbb-45e0-bad4-077518ff0565 req-84103f9b-4fb1-4805-9c8e-a018b8bbcd6a service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:39.857472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-22dbb181-acbb-45e0-bad4-077518ff0565 req-84103f9b-4fb1-4805-9c8e-a018b8bbcd6a service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:39.881172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-22dbb181-acbb-45e0-bad4-077518ff0565 req-84103f9b-4fb1-4805-9c8e-a018b8bbcd6a service nova] Creating event network-changed:814d5514-4b18-40e1-af9a-78ad704e9cac for instance 2d55f00a-823c-4f6e-9370-fbd72ea8eded on hv-cinder-82549 Jul 21 18:11:39.887257 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-22dbb181-acbb-45e0-bad4-077518ff0565 req-84103f9b-4fb1-4805-9c8e-a018b8bbcd6a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047185 Jul 21 18:11:39.887864 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 788/1591] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:11:39.955004 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-139b1abf-d459-47a4-a2df-f5236456ee58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:39.955620 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-139b1abf-d459-47a4-a2df-f5236456ee58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:39.962153 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-139b1abf-d459-47a4-a2df-f5236456ee58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:39.962621 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-139b1abf-d459-47a4-a2df-f5236456ee58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:39.963424 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-139b1abf-d459-47a4-a2df-f5236456ee58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:39.963975 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-139b1abf-d459-47a4-a2df-f5236456ee58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:40.129518 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-139b1abf-d459-47a4-a2df-f5236456ee58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:40.137623 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-139b1abf-d459-47a4-a2df-f5236456ee58 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1314 microversion: 2.1 time: 0.186451 Jul 21 18:11:40.138204 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 804/1592] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:39 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:11:40.318276 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8554a6af-e47a-404b-96ca-04b780bc0235 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:40.319141 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8554a6af-e47a-404b-96ca-04b780bc0235 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:40.328155 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8554a6af-e47a-404b-96ca-04b780bc0235 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:40.328705 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8554a6af-e47a-404b-96ca-04b780bc0235 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:40.329483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8554a6af-e47a-404b-96ca-04b780bc0235 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:40.329922 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8554a6af-e47a-404b-96ca-04b780bc0235 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:40.484760 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8554a6af-e47a-404b-96ca-04b780bc0235 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:40.494051 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8554a6af-e47a-404b-96ca-04b780bc0235 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1265 microversion: 2.1 time: 0.180110 Jul 21 18:11:40.494663 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 789/1593] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:40 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:41.165918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-0fa6604b-673f-4024-8ec8-4988c56dfd9c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:41.174332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-0fa6604b-673f-4024-8ec8-4988c56dfd9c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:41.181404 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fa6604b-673f-4024-8ec8-4988c56dfd9c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:41.181986 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fa6604b-673f-4024-8ec8-4988c56dfd9c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:41.183087 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fa6604b-673f-4024-8ec8-4988c56dfd9c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:41.183660 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-0fa6604b-673f-4024-8ec8-4988c56dfd9c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:41.332565 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-0fa6604b-673f-4024-8ec8-4988c56dfd9c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:41.340604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-0fa6604b-673f-4024-8ec8-4988c56dfd9c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1314 microversion: 2.1 time: 0.178829 Jul 21 18:11:41.341915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 805/1594] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:41 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:41.511382 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-13e2400d-3ec0-457c-b8fb-28ab92fdb48d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:41.511998 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-13e2400d-3ec0-457c-b8fb-28ab92fdb48d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:41.518619 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-13e2400d-3ec0-457c-b8fb-28ab92fdb48d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:41.519066 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-13e2400d-3ec0-457c-b8fb-28ab92fdb48d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:41.519826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-13e2400d-3ec0-457c-b8fb-28ab92fdb48d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:41.520262 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-13e2400d-3ec0-457c-b8fb-28ab92fdb48d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:41.649394 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-13e2400d-3ec0-457c-b8fb-28ab92fdb48d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:41.652943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:41.657933 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-13e2400d-3ec0-457c-b8fb-28ab92fdb48d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1265 microversion: 2.1 time: 0.150419 Jul 21 18:11:41.658498 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 790/1595] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:41 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:42.357250 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3b5faf1d-5fcd-4765-ac8c-716cc404ac53 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:42.357866 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3b5faf1d-5fcd-4765-ac8c-716cc404ac53 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:42.364981 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3b5faf1d-5fcd-4765-ac8c-716cc404ac53 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:42.365445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3b5faf1d-5fcd-4765-ac8c-716cc404ac53 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:42.366216 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3b5faf1d-5fcd-4765-ac8c-716cc404ac53 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:42.366654 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3b5faf1d-5fcd-4765-ac8c-716cc404ac53 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:42.495816 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3b5faf1d-5fcd-4765-ac8c-716cc404ac53 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:42.503302 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3b5faf1d-5fcd-4765-ac8c-716cc404ac53 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1314 microversion: 2.1 time: 0.149866 Jul 21 18:11:42.503869 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 806/1596] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:42 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:42.674912 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d8e10f36-9bf5-4b70-a038-29285b16bad0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:42.675559 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d8e10f36-9bf5-4b70-a038-29285b16bad0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:42.682430 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8e10f36-9bf5-4b70-a038-29285b16bad0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:42.682880 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8e10f36-9bf5-4b70-a038-29285b16bad0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:42.683643 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8e10f36-9bf5-4b70-a038-29285b16bad0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:42.684084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8e10f36-9bf5-4b70-a038-29285b16bad0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:42.812032 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d8e10f36-9bf5-4b70-a038-29285b16bad0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:42.820105 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d8e10f36-9bf5-4b70-a038-29285b16bad0 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1265 microversion: 2.1 time: 0.149341 Jul 21 18:11:42.820698 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 791/1597] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:42 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:43.519902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-8876f375-f4f4-4eac-95de-ee8ee5a8c672 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:43.521015 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-8876f375-f4f4-4eac-95de-ee8ee5a8c672 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:43.524410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:43.528789 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8876f375-f4f4-4eac-95de-ee8ee5a8c672 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:43.529243 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8876f375-f4f4-4eac-95de-ee8ee5a8c672 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:43.530013 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8876f375-f4f4-4eac-95de-ee8ee5a8c672 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:43.530447 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-8876f375-f4f4-4eac-95de-ee8ee5a8c672 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:43.659647 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-8876f375-f4f4-4eac-95de-ee8ee5a8c672 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:43.668073 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-8876f375-f4f4-4eac-95de-ee8ee5a8c672 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1314 microversion: 2.1 time: 0.151944 Jul 21 18:11:43.668613 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 807/1598] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:43 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:43.838411 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6c203086-ec16-4449-b17c-f2971ea2b987 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:43.839072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6c203086-ec16-4449-b17c-f2971ea2b987 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:43.845752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c203086-ec16-4449-b17c-f2971ea2b987 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:43.846206 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c203086-ec16-4449-b17c-f2971ea2b987 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:43.846982 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c203086-ec16-4449-b17c-f2971ea2b987 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:43.847424 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c203086-ec16-4449-b17c-f2971ea2b987 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:43.935040 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 18:11:43.935204 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 18:11:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:11:43.985092 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6c203086-ec16-4449-b17c-f2971ea2b987 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:43.992689 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6c203086-ec16-4449-b17c-f2971ea2b987 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1265 microversion: 2.1 time: 0.159427 Jul 21 18:11:43.993264 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 792/1599] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:43 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:44.686709 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9420f464-995d-4ff3-acfc-7c22e8e48415 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:44.687348 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9420f464-995d-4ff3-acfc-7c22e8e48415 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:44.689430 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:44.695563 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9420f464-995d-4ff3-acfc-7c22e8e48415 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:44.696011 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9420f464-995d-4ff3-acfc-7c22e8e48415 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:44.696877 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9420f464-995d-4ff3-acfc-7c22e8e48415 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:44.697331 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9420f464-995d-4ff3-acfc-7c22e8e48415 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:44.824940 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9420f464-995d-4ff3-acfc-7c22e8e48415 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:44.833522 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9420f464-995d-4ff3-acfc-7c22e8e48415 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1314 microversion: 2.1 time: 0.149760 Jul 21 18:11:44.834567 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 808/1600] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:44 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:45.009983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8277c29e-2cae-4f26-ac19-cef85a1175e6 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:45.010630 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8277c29e-2cae-4f26-ac19-cef85a1175e6 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:45.017142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8277c29e-2cae-4f26-ac19-cef85a1175e6 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:45.017599 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8277c29e-2cae-4f26-ac19-cef85a1175e6 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:45.018367 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8277c29e-2cae-4f26-ac19-cef85a1175e6 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:45.018810 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8277c29e-2cae-4f26-ac19-cef85a1175e6 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:45.149700 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8277c29e-2cae-4f26-ac19-cef85a1175e6 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:45.157213 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8277c29e-2cae-4f26-ac19-cef85a1175e6 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1265 microversion: 2.1 time: 0.151102 Jul 21 18:11:45.157783 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 793/1601] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:45 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:45.640341 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-c29a4fed-9d04-44a8-949d-caa7fe7f93bd req-5f0ac0bb-a367-4063-979b-433aac1db107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d55f00a-823c-4f6e-9370-fbd72ea8eded", "name": "network-vif-plugged", "status": "completed", "tag": "814d5514-4b18-40e1-af9a-78ad704e9cac"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:45.648587 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-c29a4fed-9d04-44a8-949d-caa7fe7f93bd req-5f0ac0bb-a367-4063-979b-433aac1db107 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:45.649036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-c29a4fed-9d04-44a8-949d-caa7fe7f93bd req-5f0ac0bb-a367-4063-979b-433aac1db107 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:45.664150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-c29a4fed-9d04-44a8-949d-caa7fe7f93bd req-5f0ac0bb-a367-4063-979b-433aac1db107 service nova] Creating event network-vif-plugged:814d5514-4b18-40e1-af9a-78ad704e9cac for instance 2d55f00a-823c-4f6e-9370-fbd72ea8eded on hv-cinder-82549 Jul 21 18:11:45.669445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-c29a4fed-9d04-44a8-949d-caa7fe7f93bd req-5f0ac0bb-a367-4063-979b-433aac1db107 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032907 Jul 21 18:11:45.670228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 809/1602] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:11:45.846766 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:45.847557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=8 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:45.852059 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9ade7853-e1e6-4819-814d-931906d1cbef tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:45.852707 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9ade7853-e1e6-4819-814d-931906d1cbef tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:45.854598 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:45.861109 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ade7853-e1e6-4819-814d-931906d1cbef tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:45.861552 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ade7853-e1e6-4819-814d-931906d1cbef tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:45.862323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ade7853-e1e6-4819-814d-931906d1cbef tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:45.862760 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ade7853-e1e6-4819-814d-931906d1cbef tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:46.005966 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9ade7853-e1e6-4819-814d-931906d1cbef tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:46.013573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9ade7853-e1e6-4819-814d-931906d1cbef tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1314 microversion: 2.1 time: 0.167454 Jul 21 18:11:46.016330 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 794/1603] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:45 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:46.174774 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-c791f0ad-0381-4ae7-a1d9-e373fdf8848c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:46.175485 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-c791f0ad-0381-4ae7-a1d9-e373fdf8848c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:46.181912 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c791f0ad-0381-4ae7-a1d9-e373fdf8848c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:46.182372 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c791f0ad-0381-4ae7-a1d9-e373fdf8848c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:46.183146 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c791f0ad-0381-4ae7-a1d9-e373fdf8848c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:46.183588 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-c791f0ad-0381-4ae7-a1d9-e373fdf8848c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:46.314197 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-c791f0ad-0381-4ae7-a1d9-e373fdf8848c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:46.322097 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-c791f0ad-0381-4ae7-a1d9-e373fdf8848c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1265 microversion: 2.1 time: 0.151875 Jul 21 18:11:46.322665 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 810/1604] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:46 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:47.031128 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dd07b1b2-15fe-4a3a-80c3-efed9142d053 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:47.031815 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dd07b1b2-15fe-4a3a-80c3-efed9142d053 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:47.039126 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd07b1b2-15fe-4a3a-80c3-efed9142d053 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:47.039573 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd07b1b2-15fe-4a3a-80c3-efed9142d053 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:47.040355 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd07b1b2-15fe-4a3a-80c3-efed9142d053 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:47.040791 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd07b1b2-15fe-4a3a-80c3-efed9142d053 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:47.170707 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dd07b1b2-15fe-4a3a-80c3-efed9142d053 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:47.179967 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dd07b1b2-15fe-4a3a-80c3-efed9142d053 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1498 microversion: 2.1 time: 0.152694 Jul 21 18:11:47.180605 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 795/1605] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:47 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:47.338899 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-273b6781-d50d-4dc8-9dbc-76ad2f67d9a5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:47.339525 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-273b6781-d50d-4dc8-9dbc-76ad2f67d9a5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:47.342008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=8 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:11:47.350650 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-273b6781-d50d-4dc8-9dbc-76ad2f67d9a5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:47.351151 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-273b6781-d50d-4dc8-9dbc-76ad2f67d9a5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:47.351972 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-273b6781-d50d-4dc8-9dbc-76ad2f67d9a5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:47.352446 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-273b6781-d50d-4dc8-9dbc-76ad2f67d9a5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:47.513771 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-273b6781-d50d-4dc8-9dbc-76ad2f67d9a5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:47.523409 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-273b6781-d50d-4dc8-9dbc-76ad2f67d9a5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1265 microversion: 2.1 time: 0.188320 Jul 21 18:11:47.523996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 811/1606] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:47 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:47.691978 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-e0b518cf-4aff-498f-9cef-2b3ec347706d req-2b4d21f9-b6dc-406d-bbfa-e444db070a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485dc0c9-e504-46b3-89bc-b42497a1eb52", "name": "network-vif-plugged", "status": "completed", "tag": "0eb22396-58ea-40e2-9e8a-963d0156bc0f"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:47.694446 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-93e67f81-88f1-4a79-8345-5b9d9989febb tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:47.694950 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-93e67f81-88f1-4a79-8345-5b9d9989febb tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:47.700511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-e0b518cf-4aff-498f-9cef-2b3ec347706d req-2b4d21f9-b6dc-406d-bbfa-e444db070a49 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:47.700847 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93e67f81-88f1-4a79-8345-5b9d9989febb tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:47.700954 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-e0b518cf-4aff-498f-9cef-2b3ec347706d req-2b4d21f9-b6dc-406d-bbfa-e444db070a49 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:47.701305 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93e67f81-88f1-4a79-8345-5b9d9989febb tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:47.702071 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93e67f81-88f1-4a79-8345-5b9d9989febb tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:47.702508 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-93e67f81-88f1-4a79-8345-5b9d9989febb tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:47.712199 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-e0b518cf-4aff-498f-9cef-2b3ec347706d req-2b4d21f9-b6dc-406d-bbfa-e444db070a49 service nova] Creating event network-vif-plugged:0eb22396-58ea-40e2-9e8a-963d0156bc0f for instance 485dc0c9-e504-46b3-89bc-b42497a1eb52 on hv-cinder-82549 Jul 21 18:11:47.717708 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-e0b518cf-4aff-498f-9cef-2b3ec347706d req-2b4d21f9-b6dc-406d-bbfa-e444db070a49 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029280 Jul 21 18:11:47.718391 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 796/1607] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:11:47.728477 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-93e67f81-88f1-4a79-8345-5b9d9989febb tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Going to try to terminate instance {{(pid=124381) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 18:11:47.805440 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-93e67f81-88f1-4a79-8345-5b9d9989febb tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 204 len: 0 microversion: 2.1 time: 0.114799 Jul 21 18:11:47.806015 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 812/1608] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:11:47 2022] DELETE /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 18:11:47.814724 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4ee422ed-e2d2-4d24-a26e-a13d8c7c4557 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:47.815434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4ee422ed-e2d2-4d24-a26e-a13d8c7c4557 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:47.822872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ee422ed-e2d2-4d24-a26e-a13d8c7c4557 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:47.823328 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ee422ed-e2d2-4d24-a26e-a13d8c7c4557 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:47.824101 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ee422ed-e2d2-4d24-a26e-a13d8c7c4557 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:47.824617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ee422ed-e2d2-4d24-a26e-a13d8c7c4557 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:47.965673 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4ee422ed-e2d2-4d24-a26e-a13d8c7c4557 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:47.973198 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4ee422ed-e2d2-4d24-a26e-a13d8c7c4557 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1504 microversion: 2.1 time: 0.162711 Jul 21 18:11:47.973765 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 797/1609] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:47 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:48.541526 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9375b415-5dbe-4912-afaf-10a3cc001f87 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:48.542233 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9375b415-5dbe-4912-afaf-10a3cc001f87 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:48.549025 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9375b415-5dbe-4912-afaf-10a3cc001f87 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:48.549479 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9375b415-5dbe-4912-afaf-10a3cc001f87 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:48.550246 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9375b415-5dbe-4912-afaf-10a3cc001f87 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:48.550686 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9375b415-5dbe-4912-afaf-10a3cc001f87 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:48.682224 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9375b415-5dbe-4912-afaf-10a3cc001f87 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:48.689609 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9375b415-5dbe-4912-afaf-10a3cc001f87 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1265 microversion: 2.1 time: 0.152240 Jul 21 18:11:48.690193 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 813/1610] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:48 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:48.991080 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7746a7a9-1c56-46f7-8fa9-6662b00583fd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:48.991700 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7746a7a9-1c56-46f7-8fa9-6662b00583fd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:48.998030 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7746a7a9-1c56-46f7-8fa9-6662b00583fd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:48.998515 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7746a7a9-1c56-46f7-8fa9-6662b00583fd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:48.999287 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7746a7a9-1c56-46f7-8fa9-6662b00583fd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:48.999732 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7746a7a9-1c56-46f7-8fa9-6662b00583fd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:49.373412 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7746a7a9-1c56-46f7-8fa9-6662b00583fd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:49.381143 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7746a7a9-1c56-46f7-8fa9-6662b00583fd tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1504 microversion: 2.1 time: 0.394369 Jul 21 18:11:49.381712 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 798/1611] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:48 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:49.706273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ac293691-2368-4bd7-ad30-04fe720ebc37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:49.706800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ac293691-2368-4bd7-ad30-04fe720ebc37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:49.714138 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ac293691-2368-4bd7-ad30-04fe720ebc37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:49.714587 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ac293691-2368-4bd7-ad30-04fe720ebc37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:49.715340 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ac293691-2368-4bd7-ad30-04fe720ebc37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:49.715780 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ac293691-2368-4bd7-ad30-04fe720ebc37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:49.847463 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ac293691-2368-4bd7-ad30-04fe720ebc37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:49.855829 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ac293691-2368-4bd7-ad30-04fe720ebc37 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1265 microversion: 2.1 time: 0.153438 Jul 21 18:11:49.856416 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 814/1612] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:49 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:50.399443 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d455dd17-6255-46a4-a44c-ad9c81ead080 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:50.400153 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d455dd17-6255-46a4-a44c-ad9c81ead080 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:50.406716 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d455dd17-6255-46a4-a44c-ad9c81ead080 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:50.407171 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d455dd17-6255-46a4-a44c-ad9c81ead080 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:50.407935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d455dd17-6255-46a4-a44c-ad9c81ead080 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:50.408394 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d455dd17-6255-46a4-a44c-ad9c81ead080 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:50.409460 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-4615a9ee-5acc-4a24-af20-7791143542e3 req-992b5da8-3729-4090-843e-28e9f873c5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d55f00a-823c-4f6e-9370-fbd72ea8eded", "name": "network-vif-deleted", "tag": "814d5514-4b18-40e1-af9a-78ad704e9cac"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:50.418636 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-4615a9ee-5acc-4a24-af20-7791143542e3 req-992b5da8-3729-4090-843e-28e9f873c5af service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:50.419309 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-4615a9ee-5acc-4a24-af20-7791143542e3 req-992b5da8-3729-4090-843e-28e9f873c5af service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:50.434182 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-4615a9ee-5acc-4a24-af20-7791143542e3 req-992b5da8-3729-4090-843e-28e9f873c5af service nova] Creating event network-vif-deleted:814d5514-4b18-40e1-af9a-78ad704e9cac for instance 2d55f00a-823c-4f6e-9370-fbd72ea8eded on hv-cinder-82549 Jul 21 18:11:50.440536 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-4615a9ee-5acc-4a24-af20-7791143542e3 req-992b5da8-3729-4090-843e-28e9f873c5af service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033931 Jul 21 18:11:50.441489 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 815/1613] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:11:50.492706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d455dd17-6255-46a4-a44c-ad9c81ead080 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2ac51306654b26ad063a6f559f3bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1469ed86624fbe90592a6ded1740ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:50.500531 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d455dd17-6255-46a4-a44c-ad9c81ead080 tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 200 len: 1462 microversion: 2.1 time: 0.105813 Jul 21 18:11:50.501127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 799/1614] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:50 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 1462 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:50.875283 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-64b7bd2d-7fdd-4042-b860-36c461bb3218 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:50.876175 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-64b7bd2d-7fdd-4042-b860-36c461bb3218 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:50.884582 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-64b7bd2d-7fdd-4042-b860-36c461bb3218 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:50.885037 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-64b7bd2d-7fdd-4042-b860-36c461bb3218 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:50.885814 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-64b7bd2d-7fdd-4042-b860-36c461bb3218 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:50.886261 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-64b7bd2d-7fdd-4042-b860-36c461bb3218 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:51.029731 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-64b7bd2d-7fdd-4042-b860-36c461bb3218 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:51.037913 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-64b7bd2d-7fdd-4042-b860-36c461bb3218 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1452 microversion: 2.1 time: 0.167753 Jul 21 18:11:51.038472 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 816/1615] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:50 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:11:51.055063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a6de5cb8-fe18-478a-a6f1-1d0c8ec17134 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:51.055690 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a6de5cb8-fe18-478a-a6f1-1d0c8ec17134 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:51.064003 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6de5cb8-fe18-478a-a6f1-1d0c8ec17134 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:51.064831 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6de5cb8-fe18-478a-a6f1-1d0c8ec17134 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:51.066223 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6de5cb8-fe18-478a-a6f1-1d0c8ec17134 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:51.067436 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6de5cb8-fe18-478a-a6f1-1d0c8ec17134 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:51.202087 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a6de5cb8-fe18-478a-a6f1-1d0c8ec17134 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:11:51.209780 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a6de5cb8-fe18-478a-a6f1-1d0c8ec17134 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1452 microversion: 2.1 time: 0.158917 Jul 21 18:11:51.210349 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 800/1616] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:51 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:11:51.517441 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ca50a625-ef10-412a-8f14-50a9e3a2fe3c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:11:51.518057 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ca50a625-ef10-412a-8f14-50a9e3a2fe3c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] [instance: 2d55f00a-823c-4f6e-9370-fbd72ea8eded] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:11:51.524349 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ca50a625-ef10-412a-8f14-50a9e3a2fe3c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:51.524800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ca50a625-ef10-412a-8f14-50a9e3a2fe3c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:51.525564 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ca50a625-ef10-412a-8f14-50a9e3a2fe3c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:51.526000 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ca50a625-ef10-412a-8f14-50a9e3a2fe3c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:51.539925 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-ca50a625-ef10-412a-8f14-50a9e3a2fe3c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] HTTP exception thrown: Instance 2d55f00a-823c-4f6e-9370-fbd72ea8eded could not be found. Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ca50a625-ef10-412a-8f14-50a9e3a2fe3c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Request method failure captured: Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded HTTP/1.1 Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2ZbAgFVGkge8Xktze39YMoMec9DusV33a2vlgv3DGpwFipQ4rCsukCFCfbmbXWeEaVmdLr7UYsvw02XZILIP2ONw9k6Lr5-Rst6qZTlIxT_ct2shL_jqErGyq4G4vZK36zJEGheiWaHa7UAkcOm13_EWscxMIHhMzSjT-KiV0Fe4380 Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 7a1469ed86624fbe90592a6ded1740ad Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-VolumesActionsTest-2051101126 Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:11:51.541628 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:11:51.542892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7a1469ed86624fbe90592a6ded1740ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7a1469ed86624fbe90592a6ded1740ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7a1469ed86624fbe90592a6ded1740ad", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7a1469ed86624fbe90592a6ded1740ad"}]}] Jul 21 18:11:51.542892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-VolumesActionsTest-2051101126 Jul 21 18:11:51.542892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 7a1469ed86624fbe90592a6ded1740ad Jul 21 18:11:51.542892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-VolumesActionsTest-2051101126 Jul 21 18:11:51.542892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-VolumesActionsTest-2051101126-project Jul 21 18:11:51.542892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:11:51.542892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:11:51.542892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 1f2ac51306654b26ad063a6f559f3bfb Jul 21 18:11:51.542892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-VolumesActionsTest-2051101126-project Jul 21 18:11:51.542892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:11:51.542892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 2d55f00a-823c-4f6e-9370-fbd72ea8eded could not be found. Jul 21 18:11:51.542892 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '2d55f00a-823c-4f6e-9370-fbd72ea8eded'} Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d55f00a-823c-4f6e-9370-fbd72ea8eded could not be found. Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:11:51.543667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d55f00a-823c-4f6e-9370-fbd72ea8eded could not be found. Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d55f00a-823c-4f6e-9370-fbd72ea8eded could not be found. Jul 21 18:11:51.544854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:11:51.546383 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ca50a625-ef10-412a-8f14-50a9e3a2fe3c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] Returning 404 to user: Instance 2d55f00a-823c-4f6e-9370-fbd72ea8eded could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:11:51.546383 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ca50a625-ef10-412a-8f14-50a9e3a2fe3c tempest-VolumesActionsTest-2051101126 tempest-VolumesActionsTest-2051101126-project] 10.222.0.57 "GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded" status: 404 len: 111 microversion: 2.1 time: 0.030558 Jul 21 18:11:51.546383 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 817/1617] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:11:51 2022] GET /compute/v2.1/servers/2d55f00a-823c-4f6e-9370-fbd72ea8eded => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:11:52.809429 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-9232ca31-395a-493a-995d-67faa1f7815f req-0ba389c7-7722-4720-862a-6f68406b4d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485dc0c9-e504-46b3-89bc-b42497a1eb52", "tag": "0eb22396-58ea-40e2-9e8a-963d0156bc0f"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:11:52.818701 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-9232ca31-395a-493a-995d-67faa1f7815f req-0ba389c7-7722-4720-862a-6f68406b4d8e service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:11:52.819156 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-9232ca31-395a-493a-995d-67faa1f7815f req-0ba389c7-7722-4720-862a-6f68406b4d8e service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:11:52.830723 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-9232ca31-395a-493a-995d-67faa1f7815f req-0ba389c7-7722-4720-862a-6f68406b4d8e service nova] Creating event network-changed:0eb22396-58ea-40e2-9e8a-963d0156bc0f for instance 485dc0c9-e504-46b3-89bc-b42497a1eb52 on hv-cinder-82549 Jul 21 18:11:52.836942 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-9232ca31-395a-493a-995d-67faa1f7815f req-0ba389c7-7722-4720-862a-6f68406b4d8e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031163 Jul 21 18:11:52.837752 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 801/1618] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:13:28.178139 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:13:28.178884 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:13:28.183204 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1541258021", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1392459256", "security_groups": [{"name": "tempest-secgroup-smoke-670077957"}], "block_device_mapping_v2": [{"uuid": "227e5306-ed5f-4a12-96d5-d9484f5ae152", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0e284ef-40f5-48ad-ba5a-1c18c4604cd6"}]}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:13:28.294676 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.network.neutron [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] validate_networks() for [('b0e284ef-40f5-48ad-ba5a-1c18c4604cd6', None, None, None, None, None)] {{(pid=124381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 18:13:28.763891 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Flavor limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 18:13:28.764342 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Image limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 18:13:28.764822 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Flavor pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 18:13:28.765238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Image pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 18:13:28.765650 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 18:13:28.774248 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:28.774689 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:28.775478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:28.775916 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:28.793316 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Getting quotas for project 076a5b3e4cd141b9bd9ef199e0fa0ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:13:28.797405 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Getting quotas for user 293d4ca894e24e4fb6c4e7aa14256d78 and project 076a5b3e4cd141b9bd9ef199e0fa0ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:13:28.852971 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Going to run 1 instances... {{(pid=124381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 18:13:28.855063 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='227e5306-ed5f-4a12-96d5-d9484f5ae152',volume_size=None,volume_type=None)] {{(pid=124381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 18:13:28.987137 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-7ed697ec-f0b9-44a7-ada2-733424876f8f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.810899 Jul 21 18:13:28.987884 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 818/1619] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 18:13:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 18:13:28.996089 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=15 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:13:28.996871 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=58 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:13:29.000885 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ec2aa360-8a3a-40d9-b6e3-0cbb15a7a937 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:29.001589 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ec2aa360-8a3a-40d9-b6e3-0cbb15a7a937 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:29.059935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ec2aa360-8a3a-40d9-b6e3-0cbb15a7a937 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:29.066665 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ec2aa360-8a3a-40d9-b6e3-0cbb15a7a937 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1095 microversion: 2.1 time: 0.072573 Jul 21 18:13:29.067234 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 802/1620] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:28 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:30.086289 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9dea9e75-e127-49bf-825c-8f627421e732 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:30.086840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9dea9e75-e127-49bf-825c-8f627421e732 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:30.095449 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9dea9e75-e127-49bf-825c-8f627421e732 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:30.095899 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9dea9e75-e127-49bf-825c-8f627421e732 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:30.096700 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9dea9e75-e127-49bf-825c-8f627421e732 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:30.097139 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9dea9e75-e127-49bf-825c-8f627421e732 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:30.161926 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9dea9e75-e127-49bf-825c-8f627421e732 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:30.170973 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9dea9e75-e127-49bf-825c-8f627421e732 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1201 microversion: 2.1 time: 0.090468 Jul 21 18:13:30.171811 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 819/1621] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:30 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:31.188383 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-14848cb1-ba6a-4348-a28a-88829631f311 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:31.188986 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-14848cb1-ba6a-4348-a28a-88829631f311 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:31.197306 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14848cb1-ba6a-4348-a28a-88829631f311 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:31.198241 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14848cb1-ba6a-4348-a28a-88829631f311 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:31.198836 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14848cb1-ba6a-4348-a28a-88829631f311 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:31.199385 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-14848cb1-ba6a-4348-a28a-88829631f311 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:31.340702 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-14848cb1-ba6a-4348-a28a-88829631f311 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:31.348415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-14848cb1-ba6a-4348-a28a-88829631f311 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1266 microversion: 2.1 time: 0.163921 Jul 21 18:13:31.349266 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 803/1622] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:31 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:31.905703 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-81464e01-1c77-4f0b-b68d-6616182b0a88 req-49780f9c-f31d-46b8-a6c6-bd61973c048b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c919dd-471d-4464-9608-6478fc1ac364", "tag": "24e12cd6-cbb4-447e-935e-fea052cccf1a"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:13:31.916325 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-81464e01-1c77-4f0b-b68d-6616182b0a88 req-49780f9c-f31d-46b8-a6c6-bd61973c048b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:31.917008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-81464e01-1c77-4f0b-b68d-6616182b0a88 req-49780f9c-f31d-46b8-a6c6-bd61973c048b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:31.932269 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-81464e01-1c77-4f0b-b68d-6616182b0a88 req-49780f9c-f31d-46b8-a6c6-bd61973c048b service nova] Creating event network-changed:24e12cd6-cbb4-447e-935e-fea052cccf1a for instance 18c919dd-471d-4464-9608-6478fc1ac364 on hv-cinder-82549 Jul 21 18:13:31.946721 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-81464e01-1c77-4f0b-b68d-6616182b0a88 req-49780f9c-f31d-46b8-a6c6-bd61973c048b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226798 Jul 21 18:13:31.947316 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 820/1623] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:13:32.366208 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8b26cb15-896d-4067-a5d6-85eadccc0023 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:32.367344 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8b26cb15-896d-4067-a5d6-85eadccc0023 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:32.373901 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b26cb15-896d-4067-a5d6-85eadccc0023 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:32.374357 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b26cb15-896d-4067-a5d6-85eadccc0023 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:32.375125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b26cb15-896d-4067-a5d6-85eadccc0023 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:32.375572 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b26cb15-896d-4067-a5d6-85eadccc0023 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:32.506589 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8b26cb15-896d-4067-a5d6-85eadccc0023 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:32.514990 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8b26cb15-896d-4067-a5d6-85eadccc0023 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1266 microversion: 2.1 time: 0.152678 Jul 21 18:13:32.515567 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 804/1624] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:32 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:33.532171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e1923881-95d4-4cf2-8b74-7ac29aff69d7 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:33.532906 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e1923881-95d4-4cf2-8b74-7ac29aff69d7 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:33.539500 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1923881-95d4-4cf2-8b74-7ac29aff69d7 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:33.539942 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1923881-95d4-4cf2-8b74-7ac29aff69d7 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:33.540743 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1923881-95d4-4cf2-8b74-7ac29aff69d7 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:33.541174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e1923881-95d4-4cf2-8b74-7ac29aff69d7 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:33.672340 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e1923881-95d4-4cf2-8b74-7ac29aff69d7 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:33.679777 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e1923881-95d4-4cf2-8b74-7ac29aff69d7 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1266 microversion: 2.1 time: 0.151870 Jul 21 18:13:33.680356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 821/1625] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:33 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:13:34.696739 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-427fc96f-cd51-4eff-9a27-46b301e934be tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:34.697365 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-427fc96f-cd51-4eff-9a27-46b301e934be tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:34.703813 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-427fc96f-cd51-4eff-9a27-46b301e934be tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:34.704263 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-427fc96f-cd51-4eff-9a27-46b301e934be tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:34.705060 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-427fc96f-cd51-4eff-9a27-46b301e934be tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:34.705502 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-427fc96f-cd51-4eff-9a27-46b301e934be tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:34.837353 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-427fc96f-cd51-4eff-9a27-46b301e934be tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:34.844860 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-427fc96f-cd51-4eff-9a27-46b301e934be tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1266 microversion: 2.1 time: 0.152367 Jul 21 18:13:34.845430 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 805/1626] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:34 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:35.867838 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bce54106-7a06-4811-8d2a-f171366ece2c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:35.868466 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bce54106-7a06-4811-8d2a-f171366ece2c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:35.874929 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bce54106-7a06-4811-8d2a-f171366ece2c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:35.875380 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bce54106-7a06-4811-8d2a-f171366ece2c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:35.876144 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bce54106-7a06-4811-8d2a-f171366ece2c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:35.876604 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bce54106-7a06-4811-8d2a-f171366ece2c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:36.011075 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-bce54106-7a06-4811-8d2a-f171366ece2c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:36.018644 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bce54106-7a06-4811-8d2a-f171366ece2c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1266 microversion: 2.1 time: 0.160974 Jul 21 18:13:36.019221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 822/1627] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:35 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:37.034871 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a506632f-741c-4a1a-8fcc-021a1aa635db tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:37.035583 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a506632f-741c-4a1a-8fcc-021a1aa635db tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:37.042786 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a506632f-741c-4a1a-8fcc-021a1aa635db tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:37.043244 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a506632f-741c-4a1a-8fcc-021a1aa635db tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:37.044014 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a506632f-741c-4a1a-8fcc-021a1aa635db tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:37.044505 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a506632f-741c-4a1a-8fcc-021a1aa635db tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:37.178619 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a506632f-741c-4a1a-8fcc-021a1aa635db tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:37.187369 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a506632f-741c-4a1a-8fcc-021a1aa635db tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1266 microversion: 2.1 time: 0.156309 Jul 21 18:13:37.187886 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 806/1628] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:37 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:38.286365 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-926de498-24ee-4eb7-b192-b08e8237817d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:38.287069 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-926de498-24ee-4eb7-b192-b08e8237817d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:38.294207 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-926de498-24ee-4eb7-b192-b08e8237817d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:38.294662 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-926de498-24ee-4eb7-b192-b08e8237817d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:38.295779 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-926de498-24ee-4eb7-b192-b08e8237817d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:38.296220 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-926de498-24ee-4eb7-b192-b08e8237817d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:38.432329 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-926de498-24ee-4eb7-b192-b08e8237817d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:38.439841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-926de498-24ee-4eb7-b192-b08e8237817d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1266 microversion: 2.1 time: 0.239946 Jul 21 18:13:38.440429 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 823/1629] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:38 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:39.456054 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-de6e661f-592c-4a32-98d2-ad105a0e0b0a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:39.456637 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-de6e661f-592c-4a32-98d2-ad105a0e0b0a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:39.458997 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:13:39.465158 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de6e661f-592c-4a32-98d2-ad105a0e0b0a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:39.465612 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de6e661f-592c-4a32-98d2-ad105a0e0b0a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:39.466380 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de6e661f-592c-4a32-98d2-ad105a0e0b0a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:39.466818 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de6e661f-592c-4a32-98d2-ad105a0e0b0a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:39.599671 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-de6e661f-592c-4a32-98d2-ad105a0e0b0a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:39.607417 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-de6e661f-592c-4a32-98d2-ad105a0e0b0a tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1266 microversion: 2.1 time: 0.155322 Jul 21 18:13:39.607988 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 807/1630] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:39 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:40.624962 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-45d3c341-f2b6-44b7-9046-d8cb4c4c6ced tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:40.625578 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-45d3c341-f2b6-44b7-9046-d8cb4c4c6ced tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:40.627689 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:13:40.628412 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=6 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:13:40.638024 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-45d3c341-f2b6-44b7-9046-d8cb4c4c6ced tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:40.638758 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-45d3c341-f2b6-44b7-9046-d8cb4c4c6ced tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:40.639952 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-45d3c341-f2b6-44b7-9046-d8cb4c4c6ced tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:40.640433 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-45d3c341-f2b6-44b7-9046-d8cb4c4c6ced tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:40.787015 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-45d3c341-f2b6-44b7-9046-d8cb4c4c6ced tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:40.795895 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-45d3c341-f2b6-44b7-9046-d8cb4c4c6ced tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1266 microversion: 2.1 time: 0.175138 Jul 21 18:13:40.796489 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 824/1631] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:40 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:41.813081 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a164e787-69a9-449d-b8fc-a95d533b28f4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:41.813718 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a164e787-69a9-449d-b8fc-a95d533b28f4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:41.820221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a164e787-69a9-449d-b8fc-a95d533b28f4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:41.820697 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a164e787-69a9-449d-b8fc-a95d533b28f4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:41.821477 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a164e787-69a9-449d-b8fc-a95d533b28f4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:41.822408 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a164e787-69a9-449d-b8fc-a95d533b28f4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:41.967723 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a164e787-69a9-449d-b8fc-a95d533b28f4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:41.976001 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a164e787-69a9-449d-b8fc-a95d533b28f4 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1266 microversion: 2.1 time: 0.166776 Jul 21 18:13:41.976604 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 808/1632] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:41 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:42.058330 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-4dbc35d6-534c-4661-b3f3-b323d6a222f1 req-d23e92ef-826f-44d3-ac97-0b0982cbe243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c919dd-471d-4464-9608-6478fc1ac364", "name": "network-vif-plugged", "status": "completed", "tag": "24e12cd6-cbb4-447e-935e-fea052cccf1a"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:13:42.066641 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-4dbc35d6-534c-4661-b3f3-b323d6a222f1 req-d23e92ef-826f-44d3-ac97-0b0982cbe243 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:42.067086 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-4dbc35d6-534c-4661-b3f3-b323d6a222f1 req-d23e92ef-826f-44d3-ac97-0b0982cbe243 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:42.080251 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-4dbc35d6-534c-4661-b3f3-b323d6a222f1 req-d23e92ef-826f-44d3-ac97-0b0982cbe243 service nova] Creating event network-vif-plugged:24e12cd6-cbb4-447e-935e-fea052cccf1a for instance 18c919dd-471d-4464-9608-6478fc1ac364 on hv-cinder-82549 Jul 21 18:13:42.085509 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-4dbc35d6-534c-4661-b3f3-b323d6a222f1 req-d23e92ef-826f-44d3-ac97-0b0982cbe243 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088217 Jul 21 18:13:42.086173 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 825/1633] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:13:42.992662 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-06db3d98-7ddc-4c56-86ff-92d5e6dbb51d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:42.993782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-06db3d98-7ddc-4c56-86ff-92d5e6dbb51d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:43.000221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06db3d98-7ddc-4c56-86ff-92d5e6dbb51d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:43.000710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06db3d98-7ddc-4c56-86ff-92d5e6dbb51d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:43.001479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06db3d98-7ddc-4c56-86ff-92d5e6dbb51d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:43.001919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06db3d98-7ddc-4c56-86ff-92d5e6dbb51d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:43.137915 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-06db3d98-7ddc-4c56-86ff-92d5e6dbb51d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:43.145387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-06db3d98-7ddc-4c56-86ff-92d5e6dbb51d tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1266 microversion: 2.1 time: 0.156801 Jul 21 18:13:43.145958 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 809/1634] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:42 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:44.163936 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-67a28823-0276-4bb0-8676-68acff039ea5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:44.164584 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-67a28823-0276-4bb0-8676-68acff039ea5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:44.171088 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-67a28823-0276-4bb0-8676-68acff039ea5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:44.171535 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-67a28823-0276-4bb0-8676-68acff039ea5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:44.172288 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-67a28823-0276-4bb0-8676-68acff039ea5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:44.173012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-67a28823-0276-4bb0-8676-68acff039ea5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:44.305299 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-67a28823-0276-4bb0-8676-68acff039ea5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:44.314262 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-67a28823-0276-4bb0-8676-68acff039ea5 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1452 microversion: 2.1 time: 0.155097 Jul 21 18:13:44.314825 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 826/1635] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:44 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:44.331058 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3a02abc9-e59b-4006-9d6b-68512e12bdba tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:44.331650 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3a02abc9-e59b-4006-9d6b-68512e12bdba tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:44.338122 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a02abc9-e59b-4006-9d6b-68512e12bdba tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:44.338563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a02abc9-e59b-4006-9d6b-68512e12bdba tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:44.339319 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a02abc9-e59b-4006-9d6b-68512e12bdba tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:44.339753 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3a02abc9-e59b-4006-9d6b-68512e12bdba tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:44.625603 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3a02abc9-e59b-4006-9d6b-68512e12bdba tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:13:44.633346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3a02abc9-e59b-4006-9d6b-68512e12bdba tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1452 microversion: 2.1 time: 0.306287 Jul 21 18:13:44.633943 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 810/1636] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:44 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1452 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:13:46.202299 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-87099f18-c1c6-46ff-b845-3b419a8e3874 req-57d249cf-ff7a-4521-b46f-2f402aedb456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c919dd-471d-4464-9608-6478fc1ac364", "tag": "24e12cd6-cbb4-447e-935e-fea052cccf1a"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:13:46.210228 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-87099f18-c1c6-46ff-b845-3b419a8e3874 req-57d249cf-ff7a-4521-b46f-2f402aedb456 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:46.210677 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-87099f18-c1c6-46ff-b845-3b419a8e3874 req-57d249cf-ff7a-4521-b46f-2f402aedb456 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:46.222077 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-87099f18-c1c6-46ff-b845-3b419a8e3874 req-57d249cf-ff7a-4521-b46f-2f402aedb456 service nova] Creating event network-changed:24e12cd6-cbb4-447e-935e-fea052cccf1a for instance 18c919dd-471d-4464-9608-6478fc1ac364 on hv-cinder-82549 Jul 21 18:13:46.226855 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-87099f18-c1c6-46ff-b845-3b419a8e3874 req-57d249cf-ff7a-4521-b46f-2f402aedb456 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028162 Jul 21 18:13:46.228114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 827/1637] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:13:47.761468 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fa82cb34-6dd2-4de9-9c62-8ce3cdc063f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:47.761957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fa82cb34-6dd2-4de9-9c62-8ce3cdc063f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:47.768472 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa82cb34-6dd2-4de9-9c62-8ce3cdc063f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:47.768921 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa82cb34-6dd2-4de9-9c62-8ce3cdc063f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:47.769675 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa82cb34-6dd2-4de9-9c62-8ce3cdc063f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:47.770180 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa82cb34-6dd2-4de9-9c62-8ce3cdc063f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:47.783099 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-fa82cb34-6dd2-4de9-9c62-8ce3cdc063f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] HTTP exception thrown: Instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e could not be found. Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fa82cb34-6dd2-4de9-9c62-8ce3cdc063f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Request method failure captured: Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e HTTP/1.1 Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Y4U-MsSn6bgNds6M968BXjsUFVBgBj51xv4nUtIMqgKDDmu8nOsEICBMzE8JPLipfQVqRCQFoCQUuFxBkjWgYn3JJ1imQGeM1FIi00QRAJYPEC2AoLi3bVGPeaL_ZtQo8HRBX4VBJnLIq9HjyBZHzCFRqIUTymGPCAbnwesZVDvg-4 Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 5161720524a4488aa42e383597d30144 Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:13:47.784779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:13:47.786139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5161720524a4488aa42e383597d30144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5161720524a4488aa42e383597d30144"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5161720524a4488aa42e383597d30144", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5161720524a4488aa42e383597d30144"}]}] Jul 21 18:13:47.786139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:13:47.786139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 5161720524a4488aa42e383597d30144 Jul 21 18:13:47.786139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:13:47.786139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeTestJSON-290364262-project Jul 21 18:13:47.786139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:13:47.786139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:13:47.786139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: 2ea3ea36439143b8a55f181170efc14a Jul 21 18:13:47.786139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeTestJSON-290364262-project Jul 21 18:13:47.786139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:13:47.786139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e could not be found. Jul 21 18:13:47.786139 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '9ff28a98-a8bf-43c7-ad64-2b693c0d419e'} Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e could not be found. Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:13:47.787145 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e could not be found. Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e could not be found. Jul 21 18:13:47.788640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:47.790095 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fa82cb34-6dd2-4de9-9c62-8ce3cdc063f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Returning 404 to user: Instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:13:47.790095 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fa82cb34-6dd2-4de9-9c62-8ce3cdc063f3 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 404 len: 111 microversion: 2.1 time: 0.028607 Jul 21 18:13:47.790095 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 811/1638] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:13:47 2022] DELETE /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:13:47.796819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-386dd0bc-77b0-4347-944f-a667f15fc859 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:47.797544 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-386dd0bc-77b0-4347-944f-a667f15fc859 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] [instance: 9ff28a98-a8bf-43c7-ad64-2b693c0d419e] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:13:47.803796 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-386dd0bc-77b0-4347-944f-a667f15fc859 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:47.804250 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-386dd0bc-77b0-4347-944f-a667f15fc859 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:47.805040 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-386dd0bc-77b0-4347-944f-a667f15fc859 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:13:47.805481 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-386dd0bc-77b0-4347-944f-a667f15fc859 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:13:47.819047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-386dd0bc-77b0-4347-944f-a667f15fc859 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] HTTP exception thrown: Instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e could not be found. Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-386dd0bc-77b0-4347-944f-a667f15fc859 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Request method failure captured: Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e HTTP/1.1 Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Y4U-MsSn6bgNds6M968BXjsUFVBgBj51xv4nUtIMqgKDDmu8nOsEICBMzE8JPLipfQVqRCQFoCQUuFxBkjWgYn3JJ1imQGeM1FIi00QRAJYPEC2AoLi3bVGPeaL_ZtQo8HRBX4VBJnLIq9HjyBZHzCFRqIUTymGPCAbnwesZVDvg-4 Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 5161720524a4488aa42e383597d30144 Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:13:47.820673 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:13:47.822030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5161720524a4488aa42e383597d30144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5161720524a4488aa42e383597d30144"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5161720524a4488aa42e383597d30144", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5161720524a4488aa42e383597d30144"}]}] Jul 21 18:13:47.822030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:13:47.822030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 5161720524a4488aa42e383597d30144 Jul 21 18:13:47.822030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-AttachVolumeTestJSON-290364262 Jul 21 18:13:47.822030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-AttachVolumeTestJSON-290364262-project Jul 21 18:13:47.822030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:13:47.822030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:13:47.822030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 2ea3ea36439143b8a55f181170efc14a Jul 21 18:13:47.822030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-AttachVolumeTestJSON-290364262-project Jul 21 18:13:47.822030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:13:47.822030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e could not be found. Jul 21 18:13:47.822030 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '9ff28a98-a8bf-43c7-ad64-2b693c0d419e'} Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e could not be found. Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:13:47.822963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e could not be found. Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e could not be found. Jul 21 18:13:47.824257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:47.825406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-386dd0bc-77b0-4347-944f-a667f15fc859 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] Returning 404 to user: Instance 9ff28a98-a8bf-43c7-ad64-2b693c0d419e could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:13:47.825406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-386dd0bc-77b0-4347-944f-a667f15fc859 tempest-AttachVolumeTestJSON-290364262 tempest-AttachVolumeTestJSON-290364262-project] 10.222.0.57 "GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e" status: 404 len: 111 microversion: 2.1 time: 0.030228 Jul 21 18:13:47.825406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 828/1639] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:13:47 2022] GET /compute/v2.1/servers/9ff28a98-a8bf-43c7-ad64-2b693c0d419e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 18:13:52.140963 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ff053603-0d1b-4d9b-bccd-527310c67ec0 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Action: 'create', calling method: .version_select at 0x7ffa2ecb8550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-3737110", "metadata": {"Type": "work"}}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ff053603-0d1b-4d9b-bccd-527310c67ec0 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Request method failure captured: Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 119 Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Zdf7-uAJ8eY4mAjpZGL5Rv-iv3swGKjjyPoCqxW44Wu6QSJdroYG0fMocuFdCiAqDji8R-PFSvuA6UJBhLNP3fJU2miBUsZ_LCN30YJO9ZAHvN2ik_ilujVE7Lu8Ql1Z8ykx15qyjsv9WfY5JrfL6xU-Z3lgn8cPy5xpDIw4aHLdAI Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 2a250b03982842529721ef841b4d122e Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:13:52.159594 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a250b03982842529721ef841b4d122e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a250b03982842529721ef841b4d122e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a250b03982842529721ef841b4d122e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a250b03982842529721ef841b4d122e"}]}] Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 2a250b03982842529721ef841b4d122e Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesNegativeTest-350769348-project Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: 61a5bf73b5ba47cc82fc41e30620fbfd Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesNegativeTest-350769348-project Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-3737110", "metadata": {"Type": "work"}}} Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: Jul 21 18:13:52.161125 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-3737110', 'metadata': {'Type': 'work'}}}} Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise error Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi '#$%' Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:13:52.162039 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 18:13:52.163566 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 18:13:52.166098 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 18:13:52.166098 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.166098 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ff053603-0d1b-4d9b-bccd-527310c67ec0 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:13:52.166098 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ff053603-0d1b-4d9b-bccd-527310c67ec0 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136102 Jul 21 18:13:52.166098 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 812/1640] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Jul 21 18:13:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 18:13:52.171268 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fc84578d-1b84-489a-9f44-8dd5d587c689 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Action: 'create', calling method: .version_select at 0x7ffa2ebd6ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-812751992", "metadata": {"Type": "work"}}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fc84578d-1b84-489a-9f44-8dd5d587c689 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Request method failure captured: Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 119 Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Zdf7-uAJ8eY4mAjpZGL5Rv-iv3swGKjjyPoCqxW44Wu6QSJdroYG0fMocuFdCiAqDji8R-PFSvuA6UJBhLNP3fJU2miBUsZ_LCN30YJO9ZAHvN2ik_ilujVE7Lu8Ql1Z8ykx15qyjsv9WfY5JrfL6xU-Z3lgn8cPy5xpDIw4aHLdAI Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 2a250b03982842529721ef841b4d122e Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:13:52.174723 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a250b03982842529721ef841b4d122e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a250b03982842529721ef841b4d122e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a250b03982842529721ef841b4d122e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a250b03982842529721ef841b4d122e"}]}] Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 2a250b03982842529721ef841b4d122e Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-VolumesNegativeTest-350769348-project Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 61a5bf73b5ba47cc82fc41e30620fbfd Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-VolumesNegativeTest-350769348-project Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-812751992", "metadata": {"Type": "work"}}} Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: Jul 21 18:13:52.176019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-812751992', 'metadata': {'Type': 'work'}}}} Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise error Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi '0' Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:13:52.176893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 18:13:52.178333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 18:13:52.179374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 18:13:52.179374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.179374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fc84578d-1b84-489a-9f44-8dd5d587c689 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:13:52.179374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fc84578d-1b84-489a-9f44-8dd5d587c689 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008919 Jul 21 18:13:52.179374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 829/1641] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Jul 21 18:13:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 18:13:52.185211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-60fef372-d4e2-4364-8413-2bee50cc77d6 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Action: 'create', calling method: .version_select at 0x7ffa2ec68a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-450975806", "metadata": {"Type": "work"}}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-60fef372-d4e2-4364-8413-2bee50cc77d6 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Request method failure captured: Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 118 Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Zdf7-uAJ8eY4mAjpZGL5Rv-iv3swGKjjyPoCqxW44Wu6QSJdroYG0fMocuFdCiAqDji8R-PFSvuA6UJBhLNP3fJU2miBUsZ_LCN30YJO9ZAHvN2ik_ilujVE7Lu8Ql1Z8ykx15qyjsv9WfY5JrfL6xU-Z3lgn8cPy5xpDIw4aHLdAI Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 2a250b03982842529721ef841b4d122e Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:13:52.188432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a250b03982842529721ef841b4d122e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a250b03982842529721ef841b4d122e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a250b03982842529721ef841b4d122e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a250b03982842529721ef841b4d122e"}]}] Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 2a250b03982842529721ef841b4d122e Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesNegativeTest-350769348-project Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: 61a5bf73b5ba47cc82fc41e30620fbfd Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesNegativeTest-350769348-project Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-450975806", "metadata": {"Type": "work"}}} Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: Jul 21 18:13:52.189782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-450975806', 'metadata': {'Type': 'work'}}}} Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise error Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi '' Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:13:52.190694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 18:13:52.192135 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 18:13:52.193228 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 18:13:52.193228 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.193228 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-60fef372-d4e2-4364-8413-2bee50cc77d6 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:13:52.193228 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-60fef372-d4e2-4364-8413-2bee50cc77d6 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008652 Jul 21 18:13:52.193228 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 813/1642] 10.222.0.57 () {60 vars in 1155 bytes} [Thu Jul 21 18:13:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 18:13:52.199887 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3b304e13-d0e1-42bc-a8a0-baba767b53b6 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Calling method '.version_select at 0x7ffa2a6df3a0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:52.230355 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-3b304e13-d0e1-42bc-a8a0-baba767b53b6 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] HTTP exception thrown: Volume tempest-invalid-1935261381 could not be found. Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3b304e13-d0e1-42bc-a8a0-baba767b53b6 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Request method failure captured: Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1935261381 HTTP/1.1 Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Zdf7-uAJ8eY4mAjpZGL5Rv-iv3swGKjjyPoCqxW44Wu6QSJdroYG0fMocuFdCiAqDji8R-PFSvuA6UJBhLNP3fJU2miBUsZ_LCN30YJO9ZAHvN2ik_ilujVE7Lu8Ql1Z8ykx15qyjsv9WfY5JrfL6xU-Z3lgn8cPy5xpDIw4aHLdAI Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 2a250b03982842529721ef841b4d122e Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:13:52.232273 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a250b03982842529721ef841b4d122e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a250b03982842529721ef841b4d122e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a250b03982842529721ef841b4d122e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a250b03982842529721ef841b4d122e"}]}] Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 2a250b03982842529721ef841b4d122e Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-VolumesNegativeTest-350769348-project Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 61a5bf73b5ba47cc82fc41e30620fbfd Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-VolumesNegativeTest-350769348-project Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Volume tempest-invalid-1935261381 could not be found. Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': 'tempest-invalid-1935261381'} Jul 21 18:13:52.233672 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1935261381 could not be found. (HTTP 404) (Request-ID: req-5dfe588b-3dc1-4080-a4b7-a55ed443cdca) Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.234540 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 18:13:52.235824 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1935261381 could not be found. Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:13:52.237016 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1935261381 could not be found. Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1935261381 could not be found. Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3b304e13-d0e1-42bc-a8a0-baba767b53b6 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Returning 404 to user: Volume tempest-invalid-1935261381 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3b304e13-d0e1-42bc-a8a0-baba767b53b6 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1935261381" status: 404 len: 99 microversion: 2.1 time: 0.038608 Jul 21 18:13:52.238085 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 830/1643] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jul 21 18:13:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1935261381 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 21 18:13:52.243096 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f727ef49-f194-4fb8-8896-e3fff6b9434b tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003736 Jul 21 18:13:52.243580 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 814/1644] 10.222.0.57 () {58 vars in 1139 bytes} [Thu Jul 21 18:13:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 18:13:52.251668 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-607e5172-435d-48d3-afe6-4e86bd7ca965 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003722 Jul 21 18:13:52.252188 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 831/1645] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jul 21 18:13:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 18:13:52.260820 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a09831b-2620-48d6-8fa2-51a2d8d6c193 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Calling method '.version_select at 0x7ffa2ecb83a0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:52.288275 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-4a09831b-2620-48d6-8fa2-51a2d8d6c193 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] HTTP exception thrown: Volume 613898df-2ab7-4448-94be-5e2466bb84dd could not be found. Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a09831b-2620-48d6-8fa2-51a2d8d6c193 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Request method failure captured: Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/os-volumes/613898df-2ab7-4448-94be-5e2466bb84dd HTTP/1.1 Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2Zdf7-uAJ8eY4mAjpZGL5Rv-iv3swGKjjyPoCqxW44Wu6QSJdroYG0fMocuFdCiAqDji8R-PFSvuA6UJBhLNP3fJU2miBUsZ_LCN30YJO9ZAHvN2ik_ilujVE7Lu8Ql1Z8ykx15qyjsv9WfY5JrfL6xU-Z3lgn8cPy5xpDIw4aHLdAI Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 2a250b03982842529721ef841b4d122e Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:13:52.290221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a250b03982842529721ef841b4d122e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a250b03982842529721ef841b4d122e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a250b03982842529721ef841b4d122e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a250b03982842529721ef841b4d122e"}]}] Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 2a250b03982842529721ef841b4d122e Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesNegativeTest-350769348-project Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: 61a5bf73b5ba47cc82fc41e30620fbfd Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesNegativeTest-350769348-project Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Volume 613898df-2ab7-4448-94be-5e2466bb84dd could not be found. Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '613898df-2ab7-4448-94be-5e2466bb84dd'} Jul 21 18:13:52.291656 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 613898df-2ab7-4448-94be-5e2466bb84dd could not be found. (HTTP 404) (Request-ID: req-16ec0e92-ad6c-4d89-82ba-3bfab5796200) Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.292591 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 18:13:52.293852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 613898df-2ab7-4448-94be-5e2466bb84dd could not be found. Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 18:13:52.295074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 613898df-2ab7-4448-94be-5e2466bb84dd could not be found. Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 613898df-2ab7-4448-94be-5e2466bb84dd could not be found. Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a09831b-2620-48d6-8fa2-51a2d8d6c193 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Returning 404 to user: Volume 613898df-2ab7-4448-94be-5e2466bb84dd could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4a09831b-2620-48d6-8fa2-51a2d8d6c193 tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/613898df-2ab7-4448-94be-5e2466bb84dd" status: 404 len: 109 microversion: 2.1 time: 0.035154 Jul 21 18:13:52.296449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 815/1646] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jul 21 18:13:52 2022] DELETE /compute/v2.1/os-volumes/613898df-2ab7-4448-94be-5e2466bb84dd => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:13:52.302230 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-be5137f5-b1ed-4130-a1d7-ec402e17761e tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Calling method '.version_select at 0x7ffa2a86f670>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:13:52.328812 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-be5137f5-b1ed-4130-a1d7-ec402e17761e tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] HTTP exception thrown: Volume 1979dd43-6e04-4487-8087-0d6c83e52a89 could not be found. Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-be5137f5-b1ed-4130-a1d7-ec402e17761e tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Request method failure captured: Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/os-volumes/1979dd43-6e04-4487-8087-0d6c83e52a89 HTTP/1.1 Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2Zdf7-uAJ8eY4mAjpZGL5Rv-iv3swGKjjyPoCqxW44Wu6QSJdroYG0fMocuFdCiAqDji8R-PFSvuA6UJBhLNP3fJU2miBUsZ_LCN30YJO9ZAHvN2ik_ilujVE7Lu8Ql1Z8ykx15qyjsv9WfY5JrfL6xU-Z3lgn8cPy5xpDIw4aHLdAI Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 2a250b03982842529721ef841b4d122e Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:13:52.330741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a250b03982842529721ef841b4d122e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2a250b03982842529721ef841b4d122e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2a250b03982842529721ef841b4d122e", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2a250b03982842529721ef841b4d122e"}]}] Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 2a250b03982842529721ef841b4d122e Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-VolumesNegativeTest-350769348 Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-VolumesNegativeTest-350769348-project Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 61a5bf73b5ba47cc82fc41e30620fbfd Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-VolumesNegativeTest-350769348-project Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Volume 1979dd43-6e04-4487-8087-0d6c83e52a89 could not be found. Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '1979dd43-6e04-4487-8087-0d6c83e52a89'} Jul 21 18:13:52.332084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1979dd43-6e04-4487-8087-0d6c83e52a89 could not be found. (HTTP 404) (Request-ID: req-8cc8758c-8c0e-4803-b334-617a883d8f23) Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.332931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 18:13:52.334018 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1979dd43-6e04-4487-8087-0d6c83e52a89 could not be found. Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 18:13:52.335168 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1979dd43-6e04-4487-8087-0d6c83e52a89 could not be found. Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1979dd43-6e04-4487-8087-0d6c83e52a89 could not be found. Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-be5137f5-b1ed-4130-a1d7-ec402e17761e tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] Returning 404 to user: Volume 1979dd43-6e04-4487-8087-0d6c83e52a89 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-be5137f5-b1ed-4130-a1d7-ec402e17761e tempest-VolumesNegativeTest-350769348 tempest-VolumesNegativeTest-350769348-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1979dd43-6e04-4487-8087-0d6c83e52a89" status: 404 len: 109 microversion: 2.1 time: 0.033656 Jul 21 18:13:52.336123 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 832/1647] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jul 21 18:13:52 2022] GET /compute/v2.1/os-volumes/1979dd43-6e04-4487-8087-0d6c83e52a89 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:14:18.061462 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jul 21 18:14:37.079223 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 18:14:37.080150 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 18:14:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:14:46.845940 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=22 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:14:46.846693 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=50 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:14:46.851060 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-95b88b4f-1c63-46c8-aa56-19716d457d49 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Action: 'create', calling method: .version_select at 0x7ffa2ecb84c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1001665156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCpWwj8AI6GSC/epQ98zM4X0kTC1sHgpOERYRJQQRWyC6s0Zri+8FQIt1EAMK3/JF42QhzEA44+w3geiCu2epbrCWjZBcdXrHZ5eR+SGq7R6pufeosNTFyDubjup82GcQ=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:14:46.865585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-95b88b4f-1c63-46c8-aa56-19716d457d49 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Getting quotas for project 62222b635de744939d6e21288baa4f67. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:14:46.869402 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-95b88b4f-1c63-46c8-aa56-19716d457d49 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Getting quotas for user 141b69f40b5d41debdc4585787c3d47c and project 62222b635de744939d6e21288baa4f67. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:14:46.881065 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [None req-95b88b4f-1c63-46c8-aa56-19716d457d49 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [1e0608d0-2264-45ff-938e-16a2f9eb5f23] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 18:14:47.889086 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [None req-95b88b4f-1c63-46c8-aa56-19716d457d49 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [1e0608d0-2264-45ff-938e-16a2f9eb5f23] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 49224. Jul 21 18:14:47.902523 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-95b88b4f-1c63-46c8-aa56-19716d457d49 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.058431 Jul 21 18:14:47.903110 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 816/1648] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 18:14:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:14:47.952839 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:14:47.953667 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=46 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:14:47.958182 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-451371234", "imageRef": "e781b7b5-120f-4291-9bba-5f428404b493", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1001665156", "networks": [{"uuid": "cd25822c-a35d-4f00-b073-90ecef30ff5b"}]}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:14:48.125346 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.network.neutron [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] validate_networks() for [('cd25822c-a35d-4f00-b073-90ecef30ff5b', None, None, None, None, None)] {{(pid=124381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 18:14:48.493351 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Flavor limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 18:14:48.493779 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Image limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 18:14:48.494252 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Flavor pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 18:14:48.494663 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Image pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 18:14:48.495078 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 18:14:48.504407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:48.504855 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:48.505647 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:48.506083 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:48.523971 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Getting quotas for project 62222b635de744939d6e21288baa4f67. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:14:48.527940 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Getting quotas for user 141b69f40b5d41debdc4585787c3d47c and project 62222b635de744939d6e21288baa4f67. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:14:48.538840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Going to run 1 instances... {{(pid=124381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 18:14:48.541044 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e781b7b5-120f-4291-9bba-5f428404b493',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 18:14:48.585118 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-06111e41-c75e-4529-9071-8af17b9b89eb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634999 Jul 21 18:14:48.585753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 833/1649] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 18:14:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 18:14:48.596429 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a4c6e3a9-2c48-43c7-9998-05b3708fecc1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:14:48.597051 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a4c6e3a9-2c48-43c7-9998-05b3708fecc1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:14:48.758151 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a4c6e3a9-2c48-43c7-9998-05b3708fecc1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:14:48.767435 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a4c6e3a9-2c48-43c7-9998-05b3708fecc1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1258 microversion: 2.1 time: 0.175106 Jul 21 18:14:48.768401 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 817/1650] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:14:48 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:14:49.784523 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-beaa6494-b4d6-4c02-b5dd-4bbe9204c095 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:14:49.785532 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-beaa6494-b4d6-4c02-b5dd-4bbe9204c095 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:14:49.792220 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-beaa6494-b4d6-4c02-b5dd-4bbe9204c095 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:49.792707 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-beaa6494-b4d6-4c02-b5dd-4bbe9204c095 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:49.793484 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-beaa6494-b4d6-4c02-b5dd-4bbe9204c095 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:49.794692 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-beaa6494-b4d6-4c02-b5dd-4bbe9204c095 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:49.867407 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-beaa6494-b4d6-4c02-b5dd-4bbe9204c095 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:14:49.877262 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-beaa6494-b4d6-4c02-b5dd-4bbe9204c095 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1316 microversion: 2.1 time: 0.096592 Jul 21 18:14:49.884843 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 834/1651] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:14:49 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1316 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:14:50.902201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-798d3d82-859f-4582-ac44-e89c2e4173ff tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:14:50.902919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-798d3d82-859f-4582-ac44-e89c2e4173ff tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:14:50.909703 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-798d3d82-859f-4582-ac44-e89c2e4173ff tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:50.910243 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-798d3d82-859f-4582-ac44-e89c2e4173ff tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:50.911093 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-798d3d82-859f-4582-ac44-e89c2e4173ff tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:50.911617 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-798d3d82-859f-4582-ac44-e89c2e4173ff tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:51.050421 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-798d3d82-859f-4582-ac44-e89c2e4173ff tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:14:51.063022 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-798d3d82-859f-4582-ac44-e89c2e4173ff tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.164708 Jul 21 18:14:51.063599 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 818/1652] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:14:50 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:14:52.080253 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-330b6283-5d23-4c79-afb5-4acbda437ce1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:14:52.080901 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-330b6283-5d23-4c79-afb5-4acbda437ce1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:14:52.087492 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-330b6283-5d23-4c79-afb5-4acbda437ce1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:52.087945 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-330b6283-5d23-4c79-afb5-4acbda437ce1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:52.088825 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-330b6283-5d23-4c79-afb5-4acbda437ce1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:52.089326 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-330b6283-5d23-4c79-afb5-4acbda437ce1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:52.243479 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-330b6283-5d23-4c79-afb5-4acbda437ce1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:14:52.253501 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-330b6283-5d23-4c79-afb5-4acbda437ce1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.176996 Jul 21 18:14:52.254490 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 835/1653] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:14:52 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:14:53.273241 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b45259cb-fac3-4cc4-a176-0065b87f28c2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:14:53.274374 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b45259cb-fac3-4cc4-a176-0065b87f28c2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:14:53.294006 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b45259cb-fac3-4cc4-a176-0065b87f28c2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:53.294511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b45259cb-fac3-4cc4-a176-0065b87f28c2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:53.295498 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b45259cb-fac3-4cc4-a176-0065b87f28c2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:53.295941 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b45259cb-fac3-4cc4-a176-0065b87f28c2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:53.437689 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b45259cb-fac3-4cc4-a176-0065b87f28c2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:14:53.445544 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b45259cb-fac3-4cc4-a176-0065b87f28c2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.176131 Jul 21 18:14:53.446256 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 819/1654] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:14:53 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:14:54.462292 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-db41c0f6-4ae6-432e-a7d5-7aefb174af1e tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:14:54.463005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-db41c0f6-4ae6-432e-a7d5-7aefb174af1e tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:14:54.472319 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db41c0f6-4ae6-432e-a7d5-7aefb174af1e tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:54.473461 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db41c0f6-4ae6-432e-a7d5-7aefb174af1e tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:54.474788 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db41c0f6-4ae6-432e-a7d5-7aefb174af1e tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:54.475519 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db41c0f6-4ae6-432e-a7d5-7aefb174af1e tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:54.618192 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-db41c0f6-4ae6-432e-a7d5-7aefb174af1e tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:14:54.626569 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-db41c0f6-4ae6-432e-a7d5-7aefb174af1e tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.168040 Jul 21 18:14:54.636339 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 836/1655] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:14:54 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:14:55.644449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dbb0b82d-495f-4b5c-af2e-3dad97e23596 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:14:55.645077 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dbb0b82d-495f-4b5c-af2e-3dad97e23596 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:14:55.652185 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dbb0b82d-495f-4b5c-af2e-3dad97e23596 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:55.656397 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dbb0b82d-495f-4b5c-af2e-3dad97e23596 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:55.657244 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dbb0b82d-495f-4b5c-af2e-3dad97e23596 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:55.657693 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dbb0b82d-495f-4b5c-af2e-3dad97e23596 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:55.798659 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dbb0b82d-495f-4b5c-af2e-3dad97e23596 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:14:55.807644 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dbb0b82d-495f-4b5c-af2e-3dad97e23596 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.167033 Jul 21 18:14:55.808226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 820/1656] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:14:55 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:14:56.824508 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-b3b3ee32-9b1a-419a-aa48-d6d1a608f9c9 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:14:56.825829 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-b3b3ee32-9b1a-419a-aa48-d6d1a608f9c9 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:14:56.832617 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3b3ee32-9b1a-419a-aa48-d6d1a608f9c9 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:56.833075 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3b3ee32-9b1a-419a-aa48-d6d1a608f9c9 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:56.833857 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3b3ee32-9b1a-419a-aa48-d6d1a608f9c9 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:56.834300 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-b3b3ee32-9b1a-419a-aa48-d6d1a608f9c9 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:56.984793 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-b3b3ee32-9b1a-419a-aa48-d6d1a608f9c9 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:14:56.992600 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-b3b3ee32-9b1a-419a-aa48-d6d1a608f9c9 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.172002 Jul 21 18:14:56.993170 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 837/1657] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:14:56 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:14:58.009690 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ddef06ab-4901-4d61-8e9e-ec4d82d5a980 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:14:58.010314 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ddef06ab-4901-4d61-8e9e-ec4d82d5a980 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:14:58.017941 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddef06ab-4901-4d61-8e9e-ec4d82d5a980 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:58.018398 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddef06ab-4901-4d61-8e9e-ec4d82d5a980 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:58.019183 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddef06ab-4901-4d61-8e9e-ec4d82d5a980 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:58.019620 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ddef06ab-4901-4d61-8e9e-ec4d82d5a980 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:58.156166 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ddef06ab-4901-4d61-8e9e-ec4d82d5a980 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:14:58.163531 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ddef06ab-4901-4d61-8e9e-ec4d82d5a980 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.157844 Jul 21 18:14:58.164097 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 821/1658] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:14:58 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:14:59.180017 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-47b7859e-b5aa-4b47-971e-31903a67cfc6 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:14:59.180653 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-47b7859e-b5aa-4b47-971e-31903a67cfc6 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:14:59.182921 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:14:59.183660 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=6 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:14:59.190180 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-47b7859e-b5aa-4b47-971e-31903a67cfc6 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:59.190656 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-47b7859e-b5aa-4b47-971e-31903a67cfc6 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:59.191422 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-47b7859e-b5aa-4b47-971e-31903a67cfc6 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:59.191857 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-47b7859e-b5aa-4b47-971e-31903a67cfc6 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:59.325901 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-47b7859e-b5aa-4b47-971e-31903a67cfc6 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:14:59.333664 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-47b7859e-b5aa-4b47-971e-31903a67cfc6 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.157660 Jul 21 18:14:59.344084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 838/1659] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:14:59 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:14:59.574525 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-7eb032db-2ff7-4cfb-9cb1-ec6f102b4131 req-06b560c6-f02c-4524-a1c9-51bfa8cce77b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782", "tag": "5b6a859c-6eae-42c2-a0f8-63b2ad723f6b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:14:59.580461 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:14:59.585174 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-7eb032db-2ff7-4cfb-9cb1-ec6f102b4131 req-06b560c6-f02c-4524-a1c9-51bfa8cce77b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:14:59.585629 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-7eb032db-2ff7-4cfb-9cb1-ec6f102b4131 req-06b560c6-f02c-4524-a1c9-51bfa8cce77b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:14:59.605616 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-7eb032db-2ff7-4cfb-9cb1-ec6f102b4131 req-06b560c6-f02c-4524-a1c9-51bfa8cce77b service nova] Creating event network-changed:5b6a859c-6eae-42c2-a0f8-63b2ad723f6b for instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 on hv-cinder-82549 Jul 21 18:14:59.612215 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-7eb032db-2ff7-4cfb-9cb1-ec6f102b4131 req-06b560c6-f02c-4524-a1c9-51bfa8cce77b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043562 Jul 21 18:14:59.612872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 822/1660] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:15:00.350567 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f234d254-0612-4776-b4c7-22428264d966 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:00.351220 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f234d254-0612-4776-b4c7-22428264d966 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:00.357932 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f234d254-0612-4776-b4c7-22428264d966 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:00.358383 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f234d254-0612-4776-b4c7-22428264d966 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:00.359152 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f234d254-0612-4776-b4c7-22428264d966 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:00.359596 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f234d254-0612-4776-b4c7-22428264d966 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:00.487257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f234d254-0612-4776-b4c7-22428264d966 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:00.494635 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f234d254-0612-4776-b4c7-22428264d966 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.148196 Jul 21 18:15:00.495195 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 839/1661] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:00 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:01.514647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8d430c71-f03e-4ea6-9537-afb7acec7ab2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:01.515311 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8d430c71-f03e-4ea6-9537-afb7acec7ab2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:01.521800 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d430c71-f03e-4ea6-9537-afb7acec7ab2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:01.522272 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d430c71-f03e-4ea6-9537-afb7acec7ab2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:01.523068 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d430c71-f03e-4ea6-9537-afb7acec7ab2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:01.523504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8d430c71-f03e-4ea6-9537-afb7acec7ab2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:01.658710 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8d430c71-f03e-4ea6-9537-afb7acec7ab2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:01.666124 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8d430c71-f03e-4ea6-9537-afb7acec7ab2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.157468 Jul 21 18:15:01.666686 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 823/1662] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:01 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:02.683039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-253b51ce-ffd0-4cdf-929b-05a9572dda23 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:02.683735 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-253b51ce-ffd0-4cdf-929b-05a9572dda23 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:02.691053 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-253b51ce-ffd0-4cdf-929b-05a9572dda23 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:02.691605 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-253b51ce-ffd0-4cdf-929b-05a9572dda23 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:02.692497 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-253b51ce-ffd0-4cdf-929b-05a9572dda23 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:02.692942 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-253b51ce-ffd0-4cdf-929b-05a9572dda23 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:02.822467 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-253b51ce-ffd0-4cdf-929b-05a9572dda23 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:02.830552 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-253b51ce-ffd0-4cdf-929b-05a9572dda23 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.151343 Jul 21 18:15:02.831132 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 840/1663] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:02 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:03.847950 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0d08cee6-7494-4938-989b-e52e734a7476 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:03.848646 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0d08cee6-7494-4938-989b-e52e734a7476 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:03.855477 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d08cee6-7494-4938-989b-e52e734a7476 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:03.856640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d08cee6-7494-4938-989b-e52e734a7476 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:03.857434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d08cee6-7494-4938-989b-e52e734a7476 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:03.857872 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d08cee6-7494-4938-989b-e52e734a7476 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:03.990032 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0d08cee6-7494-4938-989b-e52e734a7476 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:03.997390 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0d08cee6-7494-4938-989b-e52e734a7476 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.153623 Jul 21 18:15:03.998146 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 824/1664] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:03 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:04.427533 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-fc743c0d-0cac-4a9d-aa38-c94f6f4d7d8e req-254d90cc-5dbd-4fbd-908c-43a8bf734fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782", "name": "network-vif-plugged", "status": "completed", "tag": "5b6a859c-6eae-42c2-a0f8-63b2ad723f6b"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:15:04.436986 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-fc743c0d-0cac-4a9d-aa38-c94f6f4d7d8e req-254d90cc-5dbd-4fbd-908c-43a8bf734fe2 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:04.437522 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-fc743c0d-0cac-4a9d-aa38-c94f6f4d7d8e req-254d90cc-5dbd-4fbd-908c-43a8bf734fe2 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:04.449226 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-fc743c0d-0cac-4a9d-aa38-c94f6f4d7d8e req-254d90cc-5dbd-4fbd-908c-43a8bf734fe2 service nova] Creating event network-vif-plugged:5b6a859c-6eae-42c2-a0f8-63b2ad723f6b for instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 on hv-cinder-82549 Jul 21 18:15:04.454951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-fc743c0d-0cac-4a9d-aa38-c94f6f4d7d8e req-254d90cc-5dbd-4fbd-908c-43a8bf734fe2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031169 Jul 21 18:15:04.455543 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 841/1665] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:15:05.014746 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7af01cc7-83b3-48c9-8bb3-59512a735505 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:05.015434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7af01cc7-83b3-48c9-8bb3-59512a735505 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:05.022148 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7af01cc7-83b3-48c9-8bb3-59512a735505 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:05.022608 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7af01cc7-83b3-48c9-8bb3-59512a735505 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:05.023380 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7af01cc7-83b3-48c9-8bb3-59512a735505 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:05.023825 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7af01cc7-83b3-48c9-8bb3-59512a735505 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:05.150686 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7af01cc7-83b3-48c9-8bb3-59512a735505 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:05.158056 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7af01cc7-83b3-48c9-8bb3-59512a735505 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.148052 Jul 21 18:15:05.158660 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 825/1666] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:05 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:06.175061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-db2d150d-426c-4dc5-aca0-051b995a35fd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:06.175768 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-db2d150d-426c-4dc5-aca0-051b995a35fd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:06.182098 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db2d150d-426c-4dc5-aca0-051b995a35fd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:06.182557 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db2d150d-426c-4dc5-aca0-051b995a35fd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:06.183328 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db2d150d-426c-4dc5-aca0-051b995a35fd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:06.183778 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-db2d150d-426c-4dc5-aca0-051b995a35fd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:06.312190 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-db2d150d-426c-4dc5-aca0-051b995a35fd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:06.319682 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-db2d150d-426c-4dc5-aca0-051b995a35fd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1358 microversion: 2.1 time: 0.149342 Jul 21 18:15:06.320254 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 842/1667] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:06 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:07.336865 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cd09980c-b897-4e73-a294-ef0954ff0646 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:07.337487 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cd09980c-b897-4e73-a294-ef0954ff0646 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:07.344157 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd09980c-b897-4e73-a294-ef0954ff0646 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:07.344633 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd09980c-b897-4e73-a294-ef0954ff0646 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:07.345403 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd09980c-b897-4e73-a294-ef0954ff0646 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:07.345845 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd09980c-b897-4e73-a294-ef0954ff0646 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:07.713618 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cd09980c-b897-4e73-a294-ef0954ff0646 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:07.721878 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cd09980c-b897-4e73-a294-ef0954ff0646 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1548 microversion: 2.1 time: 0.388954 Jul 21 18:15:07.722450 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 826/1668] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:07 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1548 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:07.737621 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3c6ab78f-afc1-43b0-9ec1-250611806b40 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:07.738237 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3c6ab78f-afc1-43b0-9ec1-250611806b40 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:07.744636 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3c6ab78f-afc1-43b0-9ec1-250611806b40 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:07.745084 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3c6ab78f-afc1-43b0-9ec1-250611806b40 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:07.745841 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3c6ab78f-afc1-43b0-9ec1-250611806b40 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:07.746276 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3c6ab78f-afc1-43b0-9ec1-250611806b40 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:07.870445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3c6ab78f-afc1-43b0-9ec1-250611806b40 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:07.877859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3c6ab78f-afc1-43b0-9ec1-250611806b40 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1548 microversion: 2.1 time: 0.144035 Jul 21 18:15:07.878428 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 843/1669] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:07 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1548 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:07.894017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3ece5037-7025-4bbf-8156-e08b7bbbc1ce tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:07.897442 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3ece5037-7025-4bbf-8156-e08b7bbbc1ce tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:07.898215 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3ece5037-7025-4bbf-8156-e08b7bbbc1ce tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Searching by: {'deleted': False, 'project_id': '62222b635de744939d6e21288baa4f67'} {{(pid=124380) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 21 18:15:07.905726 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ece5037-7025-4bbf-8156-e08b7bbbc1ce tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:07.906176 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ece5037-7025-4bbf-8156-e08b7bbbc1ce tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:07.906975 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ece5037-7025-4bbf-8156-e08b7bbbc1ce tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:07.907411 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ece5037-7025-4bbf-8156-e08b7bbbc1ce tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:07.997255 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.multi_cell_list [None req-3ece5037-7025-4bbf-8156-e08b7bbbc1ce tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124380) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 21 18:15:08.087869 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3ece5037-7025-4bbf-8156-e08b7bbbc1ce tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.197506 Jul 21 18:15:08.088476 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 827/1670] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jul 21 18:15:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:15:08.098707 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-98688905-1f31-41a7-8887-190bf482519a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:08.099322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-98688905-1f31-41a7-8887-190bf482519a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:08.105308 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98688905-1f31-41a7-8887-190bf482519a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:08.105760 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98688905-1f31-41a7-8887-190bf482519a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:08.106526 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98688905-1f31-41a7-8887-190bf482519a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:08.106995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-98688905-1f31-41a7-8887-190bf482519a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:08.234281 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-98688905-1f31-41a7-8887-190bf482519a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:08.241807 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-98688905-1f31-41a7-8887-190bf482519a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1548 microversion: 2.1 time: 0.146734 Jul 21 18:15:08.242371 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 844/1671] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:08 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:09.751340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f0650410-97a2-4c16-84e0-23623496265c tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "809b47af-68ff-4fac-93c5-4632ea596606"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:15:09.752433 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f0650410-97a2-4c16-84e0-23623496265c tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:09.763713 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0650410-97a2-4c16-84e0-23623496265c tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:09.764213 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0650410-97a2-4c16-84e0-23623496265c tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:09.765008 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0650410-97a2-4c16-84e0-23623496265c tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:09.765444 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f0650410-97a2-4c16-84e0-23623496265c tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:10.011957 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f0650410-97a2-4c16-84e0-23623496265c tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "POST /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265112 Jul 21 18:15:10.012613 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 828/1672] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jul 21 18:15:09 2022] POST /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:15:17.545227 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-089b4ed2-63be-4294-91ab-88b47d487452 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:17.545850 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-089b4ed2-63be-4294-91ab-88b47d487452 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:17.552180 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-089b4ed2-63be-4294-91ab-88b47d487452 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:17.552664 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-089b4ed2-63be-4294-91ab-88b47d487452 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:17.553433 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-089b4ed2-63be-4294-91ab-88b47d487452 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:17.553880 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-089b4ed2-63be-4294-91ab-88b47d487452 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:17.679409 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-089b4ed2-63be-4294-91ab-88b47d487452 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:17.687691 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-089b4ed2-63be-4294-91ab-88b47d487452 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1594 microversion: 2.1 time: 0.146608 Jul 21 18:15:17.688256 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 845/1673] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:17 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1594 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:19.074351 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:15:19.079928 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-970cf44f-dd26-4bbf-894a-b029e922f62e tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:19.081012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-970cf44f-dd26-4bbf-894a-b029e922f62e tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:19.082436 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-8642c851-4c6c-4729-b5d7-f3fcaf00ed75 req-9f39779e-73e5-4247-930c-9e20dfb0744c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c919dd-471d-4464-9608-6478fc1ac364", "tag": "24e12cd6-cbb4-447e-935e-fea052cccf1a"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:15:19.087753 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:15:19.088154 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:15:19.089959 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-970cf44f-dd26-4bbf-894a-b029e922f62e tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:19.090935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-970cf44f-dd26-4bbf-894a-b029e922f62e tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:19.092091 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-970cf44f-dd26-4bbf-894a-b029e922f62e tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:19.092951 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-970cf44f-dd26-4bbf-894a-b029e922f62e tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:19.093526 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-8642c851-4c6c-4729-b5d7-f3fcaf00ed75 req-9f39779e-73e5-4247-930c-9e20dfb0744c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:19.094060 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-8642c851-4c6c-4729-b5d7-f3fcaf00ed75 req-9f39779e-73e5-4247-930c-9e20dfb0744c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:19.100981 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=71 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:15:19.110812 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-8642c851-4c6c-4729-b5d7-f3fcaf00ed75 req-9f39779e-73e5-4247-930c-9e20dfb0744c service nova] Creating event network-changed:24e12cd6-cbb4-447e-935e-fea052cccf1a for instance 18c919dd-471d-4464-9608-6478fc1ac364 on hv-cinder-82549 Jul 21 18:15:19.116090 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-8642c851-4c6c-4729-b5d7-f3fcaf00ed75 req-9f39779e-73e5-4247-930c-9e20dfb0744c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037359 Jul 21 18:15:19.119719 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 846/1674] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:15:19.123278 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:15:19.128852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-970cf44f-dd26-4bbf-894a-b029e922f62e tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 18:15:19.228745 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-970cf44f-dd26-4bbf-894a-b029e922f62e tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "DELETE /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 204 len: 0 microversion: 2.1 time: 0.154927 Jul 21 18:15:19.229685 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 829/1675] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:15:19 2022] DELETE /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 18:15:19.239846 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-fb75cdef-0f5a-43c7-b3bc-9d152a865cd9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:19.240996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-fb75cdef-0f5a-43c7-b3bc-9d152a865cd9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:19.249371 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb75cdef-0f5a-43c7-b3bc-9d152a865cd9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:19.249829 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb75cdef-0f5a-43c7-b3bc-9d152a865cd9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:19.250674 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb75cdef-0f5a-43c7-b3bc-9d152a865cd9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:19.251150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-fb75cdef-0f5a-43c7-b3bc-9d152a865cd9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:19.462272 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-fb75cdef-0f5a-43c7-b3bc-9d152a865cd9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:19.473761 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-fb75cdef-0f5a-43c7-b3bc-9d152a865cd9 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1577 microversion: 2.1 time: 0.238338 Jul 21 18:15:19.476553 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 847/1676] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:19 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1577 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:19.552028 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-0a8e6203-c173-45d3-b733-f945f0213985 req-0f41c513-0852-42cd-8a11-ff534ecf6eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782", "tag": "5b6a859c-6eae-42c2-a0f8-63b2ad723f6b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:15:19.564448 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-0a8e6203-c173-45d3-b733-f945f0213985 req-0f41c513-0852-42cd-8a11-ff534ecf6eee service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:19.564898 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-0a8e6203-c173-45d3-b733-f945f0213985 req-0f41c513-0852-42cd-8a11-ff534ecf6eee service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:19.579639 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-0a8e6203-c173-45d3-b733-f945f0213985 req-0f41c513-0852-42cd-8a11-ff534ecf6eee service nova] Creating event network-changed:5b6a859c-6eae-42c2-a0f8-63b2ad723f6b for instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 on hv-cinder-82549 Jul 21 18:15:19.585371 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-0a8e6203-c173-45d3-b733-f945f0213985 req-0f41c513-0852-42cd-8a11-ff534ecf6eee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116156 Jul 21 18:15:19.586344 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 830/1677] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:15:20.493686 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-63d50873-6dde-4264-93b4-22455f96d14b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:20.495210 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-63d50873-6dde-4264-93b4-22455f96d14b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:20.502988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-63d50873-6dde-4264-93b4-22455f96d14b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:20.503651 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-63d50873-6dde-4264-93b4-22455f96d14b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:20.504642 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-63d50873-6dde-4264-93b4-22455f96d14b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:20.505183 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-63d50873-6dde-4264-93b4-22455f96d14b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:20.656126 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-63d50873-6dde-4264-93b4-22455f96d14b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:20.664533 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-63d50873-6dde-4264-93b4-22455f96d14b tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1577 microversion: 2.1 time: 0.174870 Jul 21 18:15:20.665316 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 848/1678] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:20 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:20.710765 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-09bc4c7e-94d1-45e9-97c5-be693d70a9db tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-640218523"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:15:20.711395 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-09bc4c7e-94d1-45e9-97c5-be693d70a9db tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:20.718764 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09bc4c7e-94d1-45e9-97c5-be693d70a9db tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:20.719226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09bc4c7e-94d1-45e9-97c5-be693d70a9db tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:20.720007 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09bc4c7e-94d1-45e9-97c5-be693d70a9db tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:20.720473 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09bc4c7e-94d1-45e9-97c5-be693d70a9db tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:20.857051 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.network.security_group_api [None req-09bc4c7e-94d1-45e9-97c5-be693d70a9db tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Adding security group 7eb3f4be-9070-40cd-8acd-b52c4e085403 to port 5b6a859c-6eae-42c2-a0f8-63b2ad723f6b Jul 21 18:15:21.213413 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-09bc4c7e-94d1-45e9-97c5-be693d70a9db tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "POST /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/action" status: 202 len: 0 microversion: 2.1 time: 0.507497 Jul 21 18:15:21.214383 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 831/1679] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 18:15:20 2022] POST /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:15:21.223989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-e3b44022-ba22-49fe-a823-077bfb1ea59f tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:21.224658 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-e3b44022-ba22-49fe-a823-077bfb1ea59f tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:21.233489 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e3b44022-ba22-49fe-a823-077bfb1ea59f tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:21.235647 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e3b44022-ba22-49fe-a823-077bfb1ea59f tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:21.237206 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e3b44022-ba22-49fe-a823-077bfb1ea59f tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:21.238020 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-e3b44022-ba22-49fe-a823-077bfb1ea59f tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:21.426861 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-e3b44022-ba22-49fe-a823-077bfb1ea59f tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:21.438074 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-e3b44022-ba22-49fe-a823-077bfb1ea59f tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1640 microversion: 2.1 time: 0.218838 Jul 21 18:15:21.439472 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 849/1680] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:21 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1640 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:21.599745 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-bb8594ef-08ab-4438-a316-a8b6ec6168ad req-1ffdd7d8-601f-42c7-9d40-1989cf85d39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782", "tag": "5b6a859c-6eae-42c2-a0f8-63b2ad723f6b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:15:21.609084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-bb8594ef-08ab-4438-a316-a8b6ec6168ad req-1ffdd7d8-601f-42c7-9d40-1989cf85d39f service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:21.609720 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-bb8594ef-08ab-4438-a316-a8b6ec6168ad req-1ffdd7d8-601f-42c7-9d40-1989cf85d39f service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:21.622906 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-bb8594ef-08ab-4438-a316-a8b6ec6168ad req-1ffdd7d8-601f-42c7-9d40-1989cf85d39f service nova] Creating event network-changed:5b6a859c-6eae-42c2-a0f8-63b2ad723f6b for instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 on hv-cinder-82549 Jul 21 18:15:21.628601 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-bb8594ef-08ab-4438-a316-a8b6ec6168ad req-1ffdd7d8-601f-42c7-9d40-1989cf85d39f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032566 Jul 21 18:15:21.630128 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 832/1681] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:15:21.686438 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9eefcd9c-a41b-4b95-b3f4-20a10ae50184 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:21.687053 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9eefcd9c-a41b-4b95-b3f4-20a10ae50184 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:21.695188 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9eefcd9c-a41b-4b95-b3f4-20a10ae50184 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:21.695689 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9eefcd9c-a41b-4b95-b3f4-20a10ae50184 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:21.696523 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9eefcd9c-a41b-4b95-b3f4-20a10ae50184 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:21.697130 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9eefcd9c-a41b-4b95-b3f4-20a10ae50184 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:21.862707 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9eefcd9c-a41b-4b95-b3f4-20a10ae50184 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:21.874937 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9eefcd9c-a41b-4b95-b3f4-20a10ae50184 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 200 len: 1458 microversion: 2.1 time: 0.195521 Jul 21 18:15:21.885636 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 850/1682] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:21 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 1458 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:22.028719 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-8c23eede-a512-4a8e-961f-9a0c491bd7b3 req-393418b1-cb5f-4533-a06e-e682db6f1441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c919dd-471d-4464-9608-6478fc1ac364", "name": "network-vif-deleted", "tag": "24e12cd6-cbb4-447e-935e-fea052cccf1a"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:15:22.040092 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8c23eede-a512-4a8e-961f-9a0c491bd7b3 req-393418b1-cb5f-4533-a06e-e682db6f1441 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:22.040565 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8c23eede-a512-4a8e-961f-9a0c491bd7b3 req-393418b1-cb5f-4533-a06e-e682db6f1441 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:22.051932 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-8c23eede-a512-4a8e-961f-9a0c491bd7b3 req-393418b1-cb5f-4533-a06e-e682db6f1441 service nova] Creating event network-vif-deleted:24e12cd6-cbb4-447e-935e-fea052cccf1a for instance 18c919dd-471d-4464-9608-6478fc1ac364 on hv-cinder-82549 Jul 21 18:15:22.057575 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-8c23eede-a512-4a8e-961f-9a0c491bd7b3 req-393418b1-cb5f-4533-a06e-e682db6f1441 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035813 Jul 21 18:15:22.058575 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 833/1683] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:15:22.892988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a61fc4e3-0dea-4faf-bfbc-8213b05dc30f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:22.893579 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a61fc4e3-0dea-4faf-bfbc-8213b05dc30f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 18c919dd-471d-4464-9608-6478fc1ac364] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:22.900398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a61fc4e3-0dea-4faf-bfbc-8213b05dc30f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:22.900914 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a61fc4e3-0dea-4faf-bfbc-8213b05dc30f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:22.901718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a61fc4e3-0dea-4faf-bfbc-8213b05dc30f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:22.902219 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a61fc4e3-0dea-4faf-bfbc-8213b05dc30f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:22.916140 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-a61fc4e3-0dea-4faf-bfbc-8213b05dc30f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] HTTP exception thrown: Instance 18c919dd-471d-4464-9608-6478fc1ac364 could not be found. Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a61fc4e3-0dea-4faf-bfbc-8213b05dc30f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Request method failure captured: Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 HTTP/1.1 Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2ZYfle9wcKqdyHo9Z87EEBVjSkcCvWGEryIP-od2IVGjfqi394VJgIoLVZtPGAUr5iReDTJgUJ93sD3Cq0QGNM41ToZwtD5K24kqo6fDnn2dBfsT8hK4l_6ek81IPHvsXhgGffps8yp_eZ9AcwhJdf7lsEcYagjqY6mwOMg7CNNLOms Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 076a5b3e4cd141b9bd9ef199e0fa0ba1 Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:15:22.917828 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:15:22.919356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_076a5b3e4cd141b9bd9ef199e0fa0ba1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}] Jul 21 18:15:22.919356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:15:22.919356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 076a5b3e4cd141b9bd9ef199e0fa0ba1 Jul 21 18:15:22.919356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:15:22.919356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-TestVolumeBootPattern-1059967138-project Jul 21 18:15:22.919356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:15:22.919356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:15:22.919356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 293d4ca894e24e4fb6c4e7aa14256d78 Jul 21 18:15:22.919356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-TestVolumeBootPattern-1059967138-project Jul 21 18:15:22.919356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:15:22.919356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 18c919dd-471d-4464-9608-6478fc1ac364 could not be found. Jul 21 18:15:22.919356 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '18c919dd-471d-4464-9608-6478fc1ac364'} Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c919dd-471d-4464-9608-6478fc1ac364 could not be found. Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:15:22.920012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c919dd-471d-4464-9608-6478fc1ac364 could not be found. Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c919dd-471d-4464-9608-6478fc1ac364 could not be found. Jul 21 18:15:22.921263 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:22.922589 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a61fc4e3-0dea-4faf-bfbc-8213b05dc30f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Returning 404 to user: Instance 18c919dd-471d-4464-9608-6478fc1ac364 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:15:22.922589 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a61fc4e3-0dea-4faf-bfbc-8213b05dc30f tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364" status: 404 len: 111 microversion: 2.1 time: 0.030459 Jul 21 18:15:22.922589 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 851/1684] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:22 2022] GET /compute/v2.1/servers/18c919dd-471d-4464-9608-6478fc1ac364 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:15:26.219821 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e9168edf-c18a-4c9f-8917-94b049e5fdaa tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:26.220428 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e9168edf-c18a-4c9f-8917-94b049e5fdaa tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:26.220994 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-0b136101-7ae9-410e-a434-2f25baecbf99 req-0ef66ba1-f67b-4d94-9a06-e601e6be536b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485dc0c9-e504-46b3-89bc-b42497a1eb52", "tag": "0eb22396-58ea-40e2-9e8a-963d0156bc0f"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:15:26.227495 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9168edf-c18a-4c9f-8917-94b049e5fdaa tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:26.228189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9168edf-c18a-4c9f-8917-94b049e5fdaa tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:26.229142 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9168edf-c18a-4c9f-8917-94b049e5fdaa tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:26.229270 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-0b136101-7ae9-410e-a434-2f25baecbf99 req-0ef66ba1-f67b-4d94-9a06-e601e6be536b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:26.229599 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-0b136101-7ae9-410e-a434-2f25baecbf99 req-0ef66ba1-f67b-4d94-9a06-e601e6be536b service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:26.229702 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9168edf-c18a-4c9f-8917-94b049e5fdaa tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:26.241833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-0b136101-7ae9-410e-a434-2f25baecbf99 req-0ef66ba1-f67b-4d94-9a06-e601e6be536b service nova] Creating event network-changed:0eb22396-58ea-40e2-9e8a-963d0156bc0f for instance 485dc0c9-e504-46b3-89bc-b42497a1eb52 on hv-cinder-82549 Jul 21 18:15:26.247981 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-0b136101-7ae9-410e-a434-2f25baecbf99 req-0ef66ba1-f67b-4d94-9a06-e601e6be536b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030311 Jul 21 18:15:26.248619 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 852/1685] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:15:26.256897 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e9168edf-c18a-4c9f-8917-94b049e5fdaa tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 18:15:26.344679 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e9168edf-c18a-4c9f-8917-94b049e5fdaa tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "DELETE /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 204 len: 0 microversion: 2.1 time: 0.129910 Jul 21 18:15:26.345846 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 834/1686] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:15:26 2022] DELETE /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 18:15:26.355641 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f63cf49e-7fe2-4ad8-b4af-4251a2a26b79 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:26.357245 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f63cf49e-7fe2-4ad8-b4af-4251a2a26b79 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:26.364211 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f63cf49e-7fe2-4ad8-b4af-4251a2a26b79 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:26.364679 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f63cf49e-7fe2-4ad8-b4af-4251a2a26b79 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:26.365510 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f63cf49e-7fe2-4ad8-b4af-4251a2a26b79 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:26.365946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f63cf49e-7fe2-4ad8-b4af-4251a2a26b79 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:26.510732 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f63cf49e-7fe2-4ad8-b4af-4251a2a26b79 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:26.519081 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f63cf49e-7fe2-4ad8-b4af-4251a2a26b79 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1577 microversion: 2.1 time: 0.168588 Jul 21 18:15:26.519660 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 853/1687] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:26 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:15:27.537519 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-479ac6ac-0c76-45c1-9826-3a47678072ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:27.538258 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-479ac6ac-0c76-45c1-9826-3a47678072ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:27.545898 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-479ac6ac-0c76-45c1-9826-3a47678072ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:27.546359 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-479ac6ac-0c76-45c1-9826-3a47678072ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:27.547270 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-479ac6ac-0c76-45c1-9826-3a47678072ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:27.547766 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-479ac6ac-0c76-45c1-9826-3a47678072ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:27.679326 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-479ac6ac-0c76-45c1-9826-3a47678072ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:27.686969 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-479ac6ac-0c76-45c1-9826-3a47678072ac tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1577 microversion: 2.1 time: 0.153721 Jul 21 18:15:27.687539 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 835/1688] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:27 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:28.571584 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-7c51e958-4225-4f33-a78c-1080b95132e8 req-1d0fade2-dfeb-4998-8916-349e5e1493f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485dc0c9-e504-46b3-89bc-b42497a1eb52", "name": "network-vif-deleted", "tag": "0eb22396-58ea-40e2-9e8a-963d0156bc0f"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:15:28.581995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-7c51e958-4225-4f33-a78c-1080b95132e8 req-1d0fade2-dfeb-4998-8916-349e5e1493f9 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:28.582445 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-7c51e958-4225-4f33-a78c-1080b95132e8 req-1d0fade2-dfeb-4998-8916-349e5e1493f9 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:28.594033 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-7c51e958-4225-4f33-a78c-1080b95132e8 req-1d0fade2-dfeb-4998-8916-349e5e1493f9 service nova] Creating event network-vif-deleted:0eb22396-58ea-40e2-9e8a-963d0156bc0f for instance 485dc0c9-e504-46b3-89bc-b42497a1eb52 on hv-cinder-82549 Jul 21 18:15:28.598793 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-7c51e958-4225-4f33-a78c-1080b95132e8 req-1d0fade2-dfeb-4998-8916-349e5e1493f9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030874 Jul 21 18:15:28.599395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 854/1689] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:15:28.704215 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e9708fb7-1d69-4680-8586-5b6c4ef05aaf tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:28.704866 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e9708fb7-1d69-4680-8586-5b6c4ef05aaf tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:28.711333 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9708fb7-1d69-4680-8586-5b6c4ef05aaf tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:28.711790 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9708fb7-1d69-4680-8586-5b6c4ef05aaf tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:28.712593 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9708fb7-1d69-4680-8586-5b6c4ef05aaf tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:28.713036 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9708fb7-1d69-4680-8586-5b6c4ef05aaf tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:28.773459 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e9708fb7-1d69-4680-8586-5b6c4ef05aaf tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293d4ca894e24e4fb6c4e7aa14256d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076a5b3e4cd141b9bd9ef199e0fa0ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:28.781202 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e9708fb7-1d69-4680-8586-5b6c4ef05aaf tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 200 len: 1225 microversion: 2.1 time: 0.080830 Jul 21 18:15:28.781770 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 836/1690] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:28 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:29.799655 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-13c6ac0e-2eed-4165-99ec-823d089db2c1 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:29.800318 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-13c6ac0e-2eed-4165-99ec-823d089db2c1 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 485dc0c9-e504-46b3-89bc-b42497a1eb52] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:29.806559 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-13c6ac0e-2eed-4165-99ec-823d089db2c1 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:29.807019 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-13c6ac0e-2eed-4165-99ec-823d089db2c1 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:29.807790 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-13c6ac0e-2eed-4165-99ec-823d089db2c1 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:29.808236 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-13c6ac0e-2eed-4165-99ec-823d089db2c1 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:29.822844 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-13c6ac0e-2eed-4165-99ec-823d089db2c1 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] HTTP exception thrown: Instance 485dc0c9-e504-46b3-89bc-b42497a1eb52 could not be found. Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-13c6ac0e-2eed-4165-99ec-823d089db2c1 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Request method failure captured: Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 HTTP/1.1 Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2ZYfle9wcKqdyHo9Z87EEBVjSkcCvWGEryIP-od2IVGjfqi394VJgIoLVZtPGAUr5iReDTJgUJ93sD3Cq0QGNM41ToZwtD5K24kqo6fDnn2dBfsT8hK4l_6ek81IPHvsXhgGffps8yp_eZ9AcwhJdf7lsEcYagjqY6mwOMg7CNNLOms Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 076a5b3e4cd141b9bd9ef199e0fa0ba1 Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:15:29.824504 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:15:29.826361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_076a5b3e4cd141b9bd9ef199e0fa0ba1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}] Jul 21 18:15:29.826361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:15:29.826361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 076a5b3e4cd141b9bd9ef199e0fa0ba1 Jul 21 18:15:29.826361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:15:29.826361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-TestVolumeBootPattern-1059967138-project Jul 21 18:15:29.826361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:15:29.826361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:15:29.826361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 293d4ca894e24e4fb6c4e7aa14256d78 Jul 21 18:15:29.826361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-TestVolumeBootPattern-1059967138-project Jul 21 18:15:29.826361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:15:29.826361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 485dc0c9-e504-46b3-89bc-b42497a1eb52 could not be found. Jul 21 18:15:29.826361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '485dc0c9-e504-46b3-89bc-b42497a1eb52'} Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485dc0c9-e504-46b3-89bc-b42497a1eb52 could not be found. Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:15:29.827047 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485dc0c9-e504-46b3-89bc-b42497a1eb52 could not be found. Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485dc0c9-e504-46b3-89bc-b42497a1eb52 could not be found. Jul 21 18:15:29.828238 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:29.829506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-13c6ac0e-2eed-4165-99ec-823d089db2c1 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Returning 404 to user: Instance 485dc0c9-e504-46b3-89bc-b42497a1eb52 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:15:29.829506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-13c6ac0e-2eed-4165-99ec-823d089db2c1 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52" status: 404 len: 111 microversion: 2.1 time: 0.031737 Jul 21 18:15:29.829506 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 855/1691] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:29 2022] GET /compute/v2.1/servers/485dc0c9-e504-46b3-89bc-b42497a1eb52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:15:30.271795 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e6ca966e-e123-450b-8567-9e0b7ea80043 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:30.272329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e6ca966e-e123-450b-8567-9e0b7ea80043 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:30.279706 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e6ca966e-e123-450b-8567-9e0b7ea80043 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:30.280151 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e6ca966e-e123-450b-8567-9e0b7ea80043 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:30.280983 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e6ca966e-e123-450b-8567-9e0b7ea80043 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:30.281606 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e6ca966e-e123-450b-8567-9e0b7ea80043 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:30.294974 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-e6ca966e-e123-450b-8567-9e0b7ea80043 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] HTTP exception thrown: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e6ca966e-e123-450b-8567-9e0b7ea80043 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Request method failure captured: Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 HTTP/1.1 Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2ZYfle9wcKqdyHo9Z87EEBVjSkcCvWGEryIP-od2IVGjfqi394VJgIoLVZtPGAUr5iReDTJgUJ93sD3Cq0QGNM41ToZwtD5K24kqo6fDnn2dBfsT8hK4l_6ek81IPHvsXhgGffps8yp_eZ9AcwhJdf7lsEcYagjqY6mwOMg7CNNLOms Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 076a5b3e4cd141b9bd9ef199e0fa0ba1 Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:15:30.296645 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:15:30.298084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_076a5b3e4cd141b9bd9ef199e0fa0ba1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}] Jul 21 18:15:30.298084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:15:30.298084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 076a5b3e4cd141b9bd9ef199e0fa0ba1 Jul 21 18:15:30.298084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:15:30.298084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-TestVolumeBootPattern-1059967138-project Jul 21 18:15:30.298084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:15:30.298084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:15:30.298084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: 293d4ca894e24e4fb6c4e7aa14256d78 Jul 21 18:15:30.298084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestVolumeBootPattern-1059967138-project Jul 21 18:15:30.298084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:15:30.298084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:15:30.298084 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '3032f69c-16ce-43d7-8d6c-38275854c874'} Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:15:30.298949 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:15:30.300358 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:15:30.301919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e6ca966e-e123-450b-8567-9e0b7ea80043 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Returning 404 to user: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:15:30.301919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e6ca966e-e123-450b-8567-9e0b7ea80043 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 404 len: 111 microversion: 2.1 time: 0.030094 Jul 21 18:15:30.301919 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 837/1692] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:15:30 2022] DELETE /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:15:30.306546 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-83bf41d3-0061-4776-89d6-73e77ba6c09c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:30.307174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-83bf41d3-0061-4776-89d6-73e77ba6c09c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] [instance: 3032f69c-16ce-43d7-8d6c-38275854c874] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:30.313577 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-83bf41d3-0061-4776-89d6-73e77ba6c09c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:30.314036 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-83bf41d3-0061-4776-89d6-73e77ba6c09c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:30.314807 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-83bf41d3-0061-4776-89d6-73e77ba6c09c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:30.315252 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-83bf41d3-0061-4776-89d6-73e77ba6c09c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:30.330860 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.wsgi [None req-83bf41d3-0061-4776-89d6-73e77ba6c09c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] HTTP exception thrown: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-83bf41d3-0061-4776-89d6-73e77ba6c09c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Request method failure captured: Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: request: GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 HTTP/1.1 Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept: application/json Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Accept-Encoding: identity Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Connection: close Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Length: 0 Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Content-Type: application/json Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Host: 10.222.0.57 Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Openstack-System-Scope: None Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: User-Agent: python-urllib3/1.26.9 Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Auth-Token: gAAAAABi2ZYfle9wcKqdyHo9Z87EEBVjSkcCvWGEryIP-od2IVGjfqi394VJgIoLVZtPGAUr5iReDTJgUJ93sD3Cq0QGNM41ToZwtD5K24kqo6fDnn2dBfsT8hK4l_6ek81IPHvsXhgGffps8yp_eZ9AcwhJdf7lsEcYagjqY6mwOMg7CNNLOms Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Id: None Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Domain-Name: None Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Identity-Status: Confirmed Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Is-Admin-Project: True Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Id: default Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Domain-Name: Default Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Id: 076a5b3e4cd141b9bd9ef199e0fa0ba1 Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Project-Name: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Role: reader,member Jul 21 18:15:30.332418 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Roles: reader,member Jul 21 18:15:30.333818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_076a5b3e4cd141b9bd9ef199e0fa0ba1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/076a5b3e4cd141b9bd9ef199e0fa0ba1"}]}] Jul 21 18:15:30.333818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:15:30.333818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Id: 076a5b3e4cd141b9bd9ef199e0fa0ba1 Jul 21 18:15:30.333818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-Tenant-Name: tempest-TestVolumeBootPattern-1059967138 Jul 21 18:15:30.333818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User: tempest-TestVolumeBootPattern-1059967138-project Jul 21 18:15:30.333818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Id: default Jul 21 18:15:30.333818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Domain-Name: Default Jul 21 18:15:30.333818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Id: 293d4ca894e24e4fb6c4e7aa14256d78 Jul 21 18:15:30.333818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: X-User-Name: tempest-TestVolumeBootPattern-1059967138-project Jul 21 18:15:30.333818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: method: > Jul 21 18:15:30.333818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: exception: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:15:30.333818 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: action_args: {'id': '3032f69c-16ce-43d7-8d6c-38275854c874'} Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:15:30.334633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. Jul 21 18:15:30.335801 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR nova.api.openstack.wsgi Jul 21 18:15:30.336800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-83bf41d3-0061-4776-89d6-73e77ba6c09c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Returning 404 to user: Instance 3032f69c-16ce-43d7-8d6c-38275854c874 could not be found. {{(pid=124381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:15:30.336800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-83bf41d3-0061-4776-89d6-73e77ba6c09c tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874" status: 404 len: 111 microversion: 2.1 time: 0.031139 Jul 21 18:15:30.336800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 856/1693] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:30 2022] GET /compute/v2.1/servers/3032f69c-16ce-43d7-8d6c-38275854c874 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:15:31.624140 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9c911090-ad86-47f3-9159-887c4455ee27 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] Calling method '.version_select at 0x7ffa2c2fddc0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:31.647071 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9c911090-ad86-47f3-9159-887c4455ee27 tempest-TestVolumeBootPattern-1059967138 tempest-TestVolumeBootPattern-1059967138-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1392459256" status: 202 len: 0 microversion: 2.1 time: 0.026701 Jul 21 18:15:31.650900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 838/1694] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jul 21 18:15:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1392459256 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:15:44.050044 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4a1280b8-2563-43c1-a23a-171e9f7a5199 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:15:44.050985 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4a1280b8-2563-43c1-a23a-171e9f7a5199 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:44.053551 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=21 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:15:44.054193 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=41 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:15:44.060095 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4a1280b8-2563-43c1-a23a-171e9f7a5199 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:44.060792 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4a1280b8-2563-43c1-a23a-171e9f7a5199 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:44.061566 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4a1280b8-2563-43c1-a23a-171e9f7a5199 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:44.062004 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4a1280b8-2563-43c1-a23a-171e9f7a5199 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:44.132810 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4a1280b8-2563-43c1-a23a-171e9f7a5199 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "POST /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/action" status: 202 len: 0 microversion: 2.1 time: 0.086592 Jul 21 18:15:44.134149 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 857/1695] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 18:15:44 2022] POST /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:15:44.139179 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:15:44.140403 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:15:44.144195 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-305d42ec-e90c-4b4d-82ac-8f1243abc464 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:44.145017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-305d42ec-e90c-4b4d-82ac-8f1243abc464 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:44.154622 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-305d42ec-e90c-4b4d-82ac-8f1243abc464 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:44.155086 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-305d42ec-e90c-4b4d-82ac-8f1243abc464 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:44.155867 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-305d42ec-e90c-4b4d-82ac-8f1243abc464 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:44.156343 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-305d42ec-e90c-4b4d-82ac-8f1243abc464 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:44.308532 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-305d42ec-e90c-4b4d-82ac-8f1243abc464 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:44.317871 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-305d42ec-e90c-4b4d-82ac-8f1243abc464 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1751 microversion: 2.1 time: 0.180212 Jul 21 18:15:44.318642 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 839/1696] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:44 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:45.337738 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-bfadf195-8409-4846-a748-cd1524f7dbdd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:45.338466 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-bfadf195-8409-4846-a748-cd1524f7dbdd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:45.344712 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bfadf195-8409-4846-a748-cd1524f7dbdd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:45.345164 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bfadf195-8409-4846-a748-cd1524f7dbdd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:45.345939 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bfadf195-8409-4846-a748-cd1524f7dbdd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:45.346378 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-bfadf195-8409-4846-a748-cd1524f7dbdd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:45.497169 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-bfadf195-8409-4846-a748-cd1524f7dbdd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:45.505385 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-bfadf195-8409-4846-a748-cd1524f7dbdd tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.172390 Jul 21 18:15:45.505948 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 858/1697] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:45 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:46.522902 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-855b6308-56ef-4761-858e-cf80132ac495 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:46.523528 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-855b6308-56ef-4761-858e-cf80132ac495 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:46.530158 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-855b6308-56ef-4761-858e-cf80132ac495 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:46.530616 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-855b6308-56ef-4761-858e-cf80132ac495 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:46.531432 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-855b6308-56ef-4761-858e-cf80132ac495 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:46.531876 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-855b6308-56ef-4761-858e-cf80132ac495 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:46.675253 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-855b6308-56ef-4761-858e-cf80132ac495 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:46.683309 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-855b6308-56ef-4761-858e-cf80132ac495 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.164306 Jul 21 18:15:46.693173 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 840/1698] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:46 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:47.701417 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9f40526b-f0f5-4efa-b4f7-2111dfd24d26 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:47.702028 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-9f40526b-f0f5-4efa-b4f7-2111dfd24d26 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:47.708456 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9f40526b-f0f5-4efa-b4f7-2111dfd24d26 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:47.708906 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9f40526b-f0f5-4efa-b4f7-2111dfd24d26 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:47.709688 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9f40526b-f0f5-4efa-b4f7-2111dfd24d26 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:47.710122 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-9f40526b-f0f5-4efa-b4f7-2111dfd24d26 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:47.854027 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-9f40526b-f0f5-4efa-b4f7-2111dfd24d26 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:47.862154 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9f40526b-f0f5-4efa-b4f7-2111dfd24d26 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.165277 Jul 21 18:15:47.862711 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 859/1699] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:47 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:48.879052 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cf1246fa-3d1e-4d0c-8a61-0479019b910b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:48.879722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cf1246fa-3d1e-4d0c-8a61-0479019b910b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:48.885854 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf1246fa-3d1e-4d0c-8a61-0479019b910b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:48.886396 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf1246fa-3d1e-4d0c-8a61-0479019b910b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:48.887082 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf1246fa-3d1e-4d0c-8a61-0479019b910b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:48.887526 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf1246fa-3d1e-4d0c-8a61-0479019b910b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:49.038901 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cf1246fa-3d1e-4d0c-8a61-0479019b910b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:49.047202 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cf1246fa-3d1e-4d0c-8a61-0479019b910b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.171983 Jul 21 18:15:49.047772 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 841/1700] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:48 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:50.064469 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4402f543-99cd-4f0e-b0db-7e642801a9e2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:50.065009 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4402f543-99cd-4f0e-b0db-7e642801a9e2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:50.071536 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4402f543-99cd-4f0e-b0db-7e642801a9e2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:50.071985 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4402f543-99cd-4f0e-b0db-7e642801a9e2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:50.072768 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4402f543-99cd-4f0e-b0db-7e642801a9e2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:50.073199 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4402f543-99cd-4f0e-b0db-7e642801a9e2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:50.217314 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4402f543-99cd-4f0e-b0db-7e642801a9e2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:50.225174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4402f543-99cd-4f0e-b0db-7e642801a9e2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.164924 Jul 21 18:15:50.225740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 860/1701] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:50 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:51.242852 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-836ec99a-6833-44f2-8e7c-a384468c6585 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:51.243387 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-836ec99a-6833-44f2-8e7c-a384468c6585 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:51.249913 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-836ec99a-6833-44f2-8e7c-a384468c6585 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:51.250937 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-836ec99a-6833-44f2-8e7c-a384468c6585 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:51.251702 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-836ec99a-6833-44f2-8e7c-a384468c6585 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:51.252141 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-836ec99a-6833-44f2-8e7c-a384468c6585 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:51.391150 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-836ec99a-6833-44f2-8e7c-a384468c6585 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:51.399124 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-836ec99a-6833-44f2-8e7c-a384468c6585 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.160261 Jul 21 18:15:51.399693 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 842/1702] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:51 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:52.415974 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3f92af32-2d23-4d06-a6ab-7b98cd18ff6b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:52.416624 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3f92af32-2d23-4d06-a6ab-7b98cd18ff6b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:52.424183 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f92af32-2d23-4d06-a6ab-7b98cd18ff6b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:52.424655 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f92af32-2d23-4d06-a6ab-7b98cd18ff6b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:52.425419 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f92af32-2d23-4d06-a6ab-7b98cd18ff6b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:52.425859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3f92af32-2d23-4d06-a6ab-7b98cd18ff6b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:52.571926 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3f92af32-2d23-4d06-a6ab-7b98cd18ff6b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:52.580434 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3f92af32-2d23-4d06-a6ab-7b98cd18ff6b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.168347 Jul 21 18:15:52.581002 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 861/1703] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:52 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:53.598755 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-86fc858f-4a4e-45ad-b527-32ef034d6a11 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:53.599373 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-86fc858f-4a4e-45ad-b527-32ef034d6a11 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:53.606153 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86fc858f-4a4e-45ad-b527-32ef034d6a11 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:53.606554 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86fc858f-4a4e-45ad-b527-32ef034d6a11 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:53.607310 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86fc858f-4a4e-45ad-b527-32ef034d6a11 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:53.607743 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86fc858f-4a4e-45ad-b527-32ef034d6a11 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:53.748504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-86fc858f-4a4e-45ad-b527-32ef034d6a11 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:53.757367 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-86fc858f-4a4e-45ad-b527-32ef034d6a11 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.163425 Jul 21 18:15:53.757934 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 843/1704] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:53 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:54.773914 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-4cf4ce57-d067-4ce0-96a9-7fddceb32edb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:54.774550 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-4cf4ce57-d067-4ce0-96a9-7fddceb32edb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:54.781258 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4cf4ce57-d067-4ce0-96a9-7fddceb32edb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:54.781718 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4cf4ce57-d067-4ce0-96a9-7fddceb32edb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:54.782481 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4cf4ce57-d067-4ce0-96a9-7fddceb32edb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:54.782923 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-4cf4ce57-d067-4ce0-96a9-7fddceb32edb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:54.928613 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-4cf4ce57-d067-4ce0-96a9-7fddceb32edb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:54.936668 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-4cf4ce57-d067-4ce0-96a9-7fddceb32edb tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.166554 Jul 21 18:15:54.937249 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 862/1705] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:54 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:55.955224 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-758fc4b7-9693-47be-b40c-6afe58080693 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:55.955867 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-758fc4b7-9693-47be-b40c-6afe58080693 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:55.962172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-758fc4b7-9693-47be-b40c-6afe58080693 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:55.962624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-758fc4b7-9693-47be-b40c-6afe58080693 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:55.963381 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-758fc4b7-9693-47be-b40c-6afe58080693 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:55.963819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-758fc4b7-9693-47be-b40c-6afe58080693 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:56.107483 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-758fc4b7-9693-47be-b40c-6afe58080693 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:56.116041 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-758fc4b7-9693-47be-b40c-6afe58080693 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.165474 Jul 21 18:15:56.116703 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 844/1706] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:55 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:57.133630 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3ea87031-f02f-46ae-838e-26da98b384c1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:57.134251 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3ea87031-f02f-46ae-838e-26da98b384c1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:57.141310 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3ea87031-f02f-46ae-838e-26da98b384c1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:57.141765 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3ea87031-f02f-46ae-838e-26da98b384c1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:57.142537 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3ea87031-f02f-46ae-838e-26da98b384c1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:57.142976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3ea87031-f02f-46ae-838e-26da98b384c1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:57.281988 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3ea87031-f02f-46ae-838e-26da98b384c1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:57.289918 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3ea87031-f02f-46ae-838e-26da98b384c1 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.160128 Jul 21 18:15:57.290485 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 863/1707] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:57 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:58.306474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9c32604c-3138-46f2-9ad0-617b89ac1b5b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:58.307022 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9c32604c-3138-46f2-9ad0-617b89ac1b5b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:58.313821 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c32604c-3138-46f2-9ad0-617b89ac1b5b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:58.314281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c32604c-3138-46f2-9ad0-617b89ac1b5b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:58.315049 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c32604c-3138-46f2-9ad0-617b89ac1b5b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:58.315491 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c32604c-3138-46f2-9ad0-617b89ac1b5b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:58.456543 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9c32604c-3138-46f2-9ad0-617b89ac1b5b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:58.464415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9c32604c-3138-46f2-9ad0-617b89ac1b5b tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.161820 Jul 21 18:15:58.464980 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 845/1708] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:58 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:15:59.482158 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-80351716-dbb1-4ece-9a5c-a2a163f28c1d tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:15:59.482752 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-80351716-dbb1-4ece-9a5c-a2a163f28c1d tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:15:59.490374 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80351716-dbb1-4ece-9a5c-a2a163f28c1d tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:59.490831 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80351716-dbb1-4ece-9a5c-a2a163f28c1d tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:59.491633 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80351716-dbb1-4ece-9a5c-a2a163f28c1d tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:15:59.492073 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-80351716-dbb1-4ece-9a5c-a2a163f28c1d tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:15:59.632039 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-80351716-dbb1-4ece-9a5c-a2a163f28c1d tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:15:59.640021 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-80351716-dbb1-4ece-9a5c-a2a163f28c1d tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.161743 Jul 21 18:15:59.640816 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 864/1709] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:15:59 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:16:00.657947 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7f714195-765a-41e9-93f0-dc280e594797 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:16:00.658570 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7f714195-765a-41e9-93f0-dc280e594797 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:16:00.672064 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f714195-765a-41e9-93f0-dc280e594797 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:00.672563 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f714195-765a-41e9-93f0-dc280e594797 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:00.673356 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f714195-765a-41e9-93f0-dc280e594797 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:00.673804 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7f714195-765a-41e9-93f0-dc280e594797 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:00.813124 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7f714195-765a-41e9-93f0-dc280e594797 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:16:00.820877 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7f714195-765a-41e9-93f0-dc280e594797 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1756 microversion: 2.1 time: 0.167161 Jul 21 18:16:00.821446 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 846/1710] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:16:00 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:16:01.837855 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a48aea41-8620-4f27-8bb9-f8f46b81c28a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:16:01.838503 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a48aea41-8620-4f27-8bb9-f8f46b81c28a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:16:01.845867 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a48aea41-8620-4f27-8bb9-f8f46b81c28a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:01.846317 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a48aea41-8620-4f27-8bb9-f8f46b81c28a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:01.847080 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a48aea41-8620-4f27-8bb9-f8f46b81c28a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:01.847520 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a48aea41-8620-4f27-8bb9-f8f46b81c28a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:01.991028 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a48aea41-8620-4f27-8bb9-f8f46b81c28a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:16:01.998915 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a48aea41-8620-4f27-8bb9-f8f46b81c28a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1759 microversion: 2.1 time: 0.164928 Jul 21 18:16:01.999980 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 865/1711] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:16:01 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:16:31.162211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a228b57e-c482-451e-9ecb-99fb364bc411 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-640218523"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:16:31.162784 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a228b57e-c482-451e-9ecb-99fb364bc411 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:16:31.164819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=16 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:16:31.165474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=48 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:16:31.171312 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a228b57e-c482-451e-9ecb-99fb364bc411 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:31.171763 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a228b57e-c482-451e-9ecb-99fb364bc411 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:31.172599 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a228b57e-c482-451e-9ecb-99fb364bc411 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:31.173040 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a228b57e-c482-451e-9ecb-99fb364bc411 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:31.298612 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.network.security_group_api [None req-a228b57e-c482-451e-9ecb-99fb364bc411 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Removing security group 7eb3f4be-9070-40cd-8acd-b52c4e085403 from port 5b6a859c-6eae-42c2-a0f8-63b2ad723f6b Jul 21 18:16:31.629713 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a228b57e-c482-451e-9ecb-99fb364bc411 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "POST /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/action" status: 202 len: 0 microversion: 2.1 time: 0.471936 Jul 21 18:16:31.630423 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 847/1712] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 18:16:31 2022] POST /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:16:31.638357 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-a117f264-a5ba-464d-b5a3-c9b09296a5a9 req-4d36870e-1d79-4655-8db8-6c14ec7f8d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782", "tag": "5b6a859c-6eae-42c2-a0f8-63b2ad723f6b"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:16:31.643058 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=18 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:16:31.644981 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:16:31.652774 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-a117f264-a5ba-464d-b5a3-c9b09296a5a9 req-4d36870e-1d79-4655-8db8-6c14ec7f8d86 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:31.653618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-a117f264-a5ba-464d-b5a3-c9b09296a5a9 req-4d36870e-1d79-4655-8db8-6c14ec7f8d86 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:31.684086 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-a117f264-a5ba-464d-b5a3-c9b09296a5a9 req-4d36870e-1d79-4655-8db8-6c14ec7f8d86 service nova] Creating event network-changed:5b6a859c-6eae-42c2-a0f8-63b2ad723f6b for instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 on hv-cinder-82549 Jul 21 18:16:31.691204 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-a117f264-a5ba-464d-b5a3-c9b09296a5a9 req-4d36870e-1d79-4655-8db8-6c14ec7f8d86 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055948 Jul 21 18:16:31.692041 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 866/1713] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:16:33.048815 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eb8c2a07-0374-47f3-a8af-778268ff71cc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:16:33.049346 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eb8c2a07-0374-47f3-a8af-778268ff71cc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:16:33.056201 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb8c2a07-0374-47f3-a8af-778268ff71cc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:33.056685 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb8c2a07-0374-47f3-a8af-778268ff71cc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:33.057449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb8c2a07-0374-47f3-a8af-778268ff71cc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:33.057881 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eb8c2a07-0374-47f3-a8af-778268ff71cc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:33.140722 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-eb8c2a07-0374-47f3-a8af-778268ff71cc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lazy-loading 'services' on Instance uuid 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 18:16:33.215182 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eb8c2a07-0374-47f3-a8af-778268ff71cc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "DELETE /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/os-volume_attachments/809b47af-68ff-4fac-93c5-4632ea596606" status: 202 len: 0 microversion: 2.1 time: 0.170690 Jul 21 18:16:33.216251 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 848/1714] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 18:16:33 2022] DELETE /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/os-volume_attachments/809b47af-68ff-4fac-93c5-4632ea596606 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:16:33.225939 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a106a20b-cb3c-4962-ac93-5a9ba94257a3 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:16:33.227642 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a106a20b-cb3c-4962-ac93-5a9ba94257a3 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:16:33.234596 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a106a20b-cb3c-4962-ac93-5a9ba94257a3 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:33.235070 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a106a20b-cb3c-4962-ac93-5a9ba94257a3 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:33.235799 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a106a20b-cb3c-4962-ac93-5a9ba94257a3 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:33.236598 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a106a20b-cb3c-4962-ac93-5a9ba94257a3 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:33.268462 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a106a20b-cb3c-4962-ac93-5a9ba94257a3 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047994 Jul 21 18:16:33.269188 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 867/1715] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 18:16:33 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 18:16:33.707427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-63f79671-f3b2-44c4-99e2-f3fe59b8e980 req-2b807360-6f7b-471d-bd95-97522d2ef331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782", "tag": "5b6a859c-6eae-42c2-a0f8-63b2ad723f6b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:16:33.715910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-63f79671-f3b2-44c4-99e2-f3fe59b8e980 req-2b807360-6f7b-471d-bd95-97522d2ef331 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:33.716281 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-63f79671-f3b2-44c4-99e2-f3fe59b8e980 req-2b807360-6f7b-471d-bd95-97522d2ef331 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:33.728673 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-63f79671-f3b2-44c4-99e2-f3fe59b8e980 req-2b807360-6f7b-471d-bd95-97522d2ef331 service nova] Creating event network-changed:5b6a859c-6eae-42c2-a0f8-63b2ad723f6b for instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 on hv-cinder-82549 Jul 21 18:16:33.733345 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-63f79671-f3b2-44c4-99e2-f3fe59b8e980 req-2b807360-6f7b-471d-bd95-97522d2ef331 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030744 Jul 21 18:16:33.733935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 849/1716] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:16:34.280951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6ace83ac-ef73-4df6-8efc-2ee8ff6440ae tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:16:34.282508 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6ace83ac-ef73-4df6-8efc-2ee8ff6440ae tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:16:34.289046 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ace83ac-ef73-4df6-8efc-2ee8ff6440ae tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:34.289495 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ace83ac-ef73-4df6-8efc-2ee8ff6440ae tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:34.290426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ace83ac-ef73-4df6-8efc-2ee8ff6440ae tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:34.290862 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ace83ac-ef73-4df6-8efc-2ee8ff6440ae tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:34.320181 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6ace83ac-ef73-4df6-8efc-2ee8ff6440ae tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043525 Jul 21 18:16:34.321005 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 868/1717] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jul 21 18:16:34 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 18:16:34.334756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0160c720-f496-478d-829b-f5bb95de9bc0 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:16:34.335980 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0160c720-f496-478d-829b-f5bb95de9bc0 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:16:34.343772 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0160c720-f496-478d-829b-f5bb95de9bc0 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:34.344427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0160c720-f496-478d-829b-f5bb95de9bc0 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:34.345537 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0160c720-f496-478d-829b-f5bb95de9bc0 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:34.345986 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0160c720-f496-478d-829b-f5bb95de9bc0 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:34.420221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-0160c720-f496-478d-829b-f5bb95de9bc0 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] HTTP exception thrown: Instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 is not attached to volume 809b47af-68ff-4fac-93c5-4632ea596606 Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0160c720-f496-478d-829b-f5bb95de9bc0 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Request method failure captured: Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/os-volume_attachments/809b47af-68ff-4fac-93c5-4632ea596606 HTTP/1.1 Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2ZeIweVzY2X9yxmaFYE1qj5Ra8yPW3JppvDLd5pc14-orOFOG3I0sUgUiYi-Rs7W8syqfQnEYbVD9SBRdhG862SnomWbFliJwCZI-uw4YYIzX6hLFe6VL70zoav5IxdGhLRZ14A9TCWLuO2xN6875XeMvD3Hon0SLb77L-I3tPBUjug Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 62222b635de744939d6e21288baa4f67 Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestMinimumBasicScenario-1643140050 Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:16:34.422624 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:16:34.423948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62222b635de744939d6e21288baa4f67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62222b635de744939d6e21288baa4f67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_62222b635de744939d6e21288baa4f67", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/62222b635de744939d6e21288baa4f67"}]}] Jul 21 18:16:34.423948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestMinimumBasicScenario-1643140050 Jul 21 18:16:34.423948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 62222b635de744939d6e21288baa4f67 Jul 21 18:16:34.423948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1643140050 Jul 21 18:16:34.423948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-TestMinimumBasicScenario-1643140050-project Jul 21 18:16:34.423948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:16:34.423948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:16:34.423948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: 141b69f40b5d41debdc4585787c3d47c Jul 21 18:16:34.423948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestMinimumBasicScenario-1643140050-project Jul 21 18:16:34.423948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:16:34.423948 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 is not attached to volume 809b47af-68ff-4fac-93c5-4632ea596606 Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'server_id': '60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782', 'id': '809b47af-68ff-4fac-93c5-4632ea596606'} Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 809b47af-68ff-4fac-93c5-4632ea596606. Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:16:34.425189 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 is not attached to volume 809b47af-68ff-4fac-93c5-4632ea596606 Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 is not attached to volume 809b47af-68ff-4fac-93c5-4632ea596606 Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:16:34.426691 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0160c720-f496-478d-829b-f5bb95de9bc0 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Returning 404 to user: Instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 is not attached to volume 809b47af-68ff-4fac-93c5-4632ea596606 {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:16:34.427712 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0160c720-f496-478d-829b-f5bb95de9bc0 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "DELETE /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/os-volume_attachments/809b47af-68ff-4fac-93c5-4632ea596606" status: 404 len: 154 microversion: 2.1 time: 0.095319 Jul 21 18:16:34.427712 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 850/1718] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jul 21 18:16:34 2022] DELETE /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782/os-volume_attachments/809b47af-68ff-4fac-93c5-4632ea596606 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:16:35.558893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d3da4151-4ab3-4b48-bc85-f7ed747d7628 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:16:35.559390 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d3da4151-4ab3-4b48-bc85-f7ed747d7628 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:16:35.566548 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d3da4151-4ab3-4b48-bc85-f7ed747d7628 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:35.566997 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d3da4151-4ab3-4b48-bc85-f7ed747d7628 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:35.567755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d3da4151-4ab3-4b48-bc85-f7ed747d7628 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:35.568185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d3da4151-4ab3-4b48-bc85-f7ed747d7628 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:35.593625 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d3da4151-4ab3-4b48-bc85-f7ed747d7628 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Going to try to terminate instance {{(pid=124381) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 18:16:35.665558 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d3da4151-4ab3-4b48-bc85-f7ed747d7628 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "DELETE /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 204 len: 0 microversion: 2.1 time: 0.110126 Jul 21 18:16:35.666050 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 869/1719] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:16:35 2022] DELETE /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 18:16:35.674741 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-70645ccf-fdbd-423d-b24f-e27e98ce6f20 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:16:35.675414 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-70645ccf-fdbd-423d-b24f-e27e98ce6f20 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:16:35.681960 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70645ccf-fdbd-423d-b24f-e27e98ce6f20 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:35.682438 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70645ccf-fdbd-423d-b24f-e27e98ce6f20 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:35.683216 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70645ccf-fdbd-423d-b24f-e27e98ce6f20 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:35.683657 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-70645ccf-fdbd-423d-b24f-e27e98ce6f20 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:35.816393 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-70645ccf-fdbd-423d-b24f-e27e98ce6f20 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:16:35.823877 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-70645ccf-fdbd-423d-b24f-e27e98ce6f20 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1554 microversion: 2.1 time: 0.153212 Jul 21 18:16:35.824481 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 851/1720] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:16:35 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:16:36.842416 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-6ae7d268-b7c4-4ed3-9b82-c1013daccdbf tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:16:36.843122 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-6ae7d268-b7c4-4ed3-9b82-c1013daccdbf tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:16:36.850332 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ae7d268-b7c4-4ed3-9b82-c1013daccdbf tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:36.850789 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ae7d268-b7c4-4ed3-9b82-c1013daccdbf tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:36.851556 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ae7d268-b7c4-4ed3-9b82-c1013daccdbf tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:36.851995 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-6ae7d268-b7c4-4ed3-9b82-c1013daccdbf tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:36.982516 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-6ae7d268-b7c4-4ed3-9b82-c1013daccdbf tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:16:36.990174 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-6ae7d268-b7c4-4ed3-9b82-c1013daccdbf tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1554 microversion: 2.1 time: 0.152012 Jul 21 18:16:36.990743 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 870/1721] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:16:36 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:16:37.878114 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-a6c67d95-6569-4d0a-bd06-ae060d45e1ba req-1c6d5706-c503-4f0f-85fd-3cd0a7fde0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782", "name": "network-vif-deleted", "tag": "5b6a859c-6eae-42c2-a0f8-63b2ad723f6b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:16:37.888329 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-a6c67d95-6569-4d0a-bd06-ae060d45e1ba req-1c6d5706-c503-4f0f-85fd-3cd0a7fde0cb service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:37.888766 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-a6c67d95-6569-4d0a-bd06-ae060d45e1ba req-1c6d5706-c503-4f0f-85fd-3cd0a7fde0cb service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:37.901725 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-a6c67d95-6569-4d0a-bd06-ae060d45e1ba req-1c6d5706-c503-4f0f-85fd-3cd0a7fde0cb service nova] Creating event network-vif-deleted:5b6a859c-6eae-42c2-a0f8-63b2ad723f6b for instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 on hv-cinder-82549 Jul 21 18:16:37.907027 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-a6c67d95-6569-4d0a-bd06-ae060d45e1ba req-1c6d5706-c503-4f0f-85fd-3cd0a7fde0cb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032896 Jul 21 18:16:37.907833 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 852/1722] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:16:38.007053 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5a6e94ba-993c-4cf1-9fba-d5c76c13373a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:16:38.007681 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5a6e94ba-993c-4cf1-9fba-d5c76c13373a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:16:38.014167 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a6e94ba-993c-4cf1-9fba-d5c76c13373a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:38.014627 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a6e94ba-993c-4cf1-9fba-d5c76c13373a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:38.015406 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a6e94ba-993c-4cf1-9fba-d5c76c13373a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:38.015857 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a6e94ba-993c-4cf1-9fba-d5c76c13373a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:38.050976 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a6e94ba-993c-4cf1-9fba-d5c76c13373a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:38.051426 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5a6e94ba-993c-4cf1-9fba-d5c76c13373a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:38.051884 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.objects.instance [None req-5a6e94ba-993c-4cf1-9fba-d5c76c13373a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lazy-loading 'fault' on Instance uuid 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 {{(pid=124381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 18:16:38.091955 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5a6e94ba-993c-4cf1-9fba-d5c76c13373a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141b69f40b5d41debdc4585787c3d47c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62222b635de744939d6e21288baa4f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:16:38.100027 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5a6e94ba-993c-4cf1-9fba-d5c76c13373a tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 200 len: 1348 microversion: 2.1 time: 0.096930 Jul 21 18:16:38.100641 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 871/1723] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:16:38 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:16:39.118045 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0e2b7e34-cb31-412c-b86b-d1182aa908fc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:16:39.118743 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0e2b7e34-cb31-412c-b86b-d1182aa908fc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [instance: 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:16:39.124896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e2b7e34-cb31-412c-b86b-d1182aa908fc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:39.125337 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e2b7e34-cb31-412c-b86b-d1182aa908fc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:39.126091 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e2b7e34-cb31-412c-b86b-d1182aa908fc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:16:39.126521 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0e2b7e34-cb31-412c-b86b-d1182aa908fc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:16:39.140289 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-0e2b7e34-cb31-412c-b86b-d1182aa908fc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] HTTP exception thrown: Instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 could not be found. Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0e2b7e34-cb31-412c-b86b-d1182aa908fc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Request method failure captured: Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 HTTP/1.1 Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2ZeIweVzY2X9yxmaFYE1qj5Ra8yPW3JppvDLd5pc14-orOFOG3I0sUgUiYi-Rs7W8syqfQnEYbVD9SBRdhG862SnomWbFliJwCZI-uw4YYIzX6hLFe6VL70zoav5IxdGhLRZ14A9TCWLuO2xN6875XeMvD3Hon0SLb77L-I3tPBUjug Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: 62222b635de744939d6e21288baa4f67 Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestMinimumBasicScenario-1643140050 Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:16:39.141837 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:16:39.143323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62222b635de744939d6e21288baa4f67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/62222b635de744939d6e21288baa4f67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_62222b635de744939d6e21288baa4f67", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/62222b635de744939d6e21288baa4f67"}]}] Jul 21 18:16:39.143323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestMinimumBasicScenario-1643140050 Jul 21 18:16:39.143323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 62222b635de744939d6e21288baa4f67 Jul 21 18:16:39.143323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1643140050 Jul 21 18:16:39.143323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-TestMinimumBasicScenario-1643140050-project Jul 21 18:16:39.143323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:16:39.143323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:16:39.143323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: 141b69f40b5d41debdc4585787c3d47c Jul 21 18:16:39.143323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestMinimumBasicScenario-1643140050-project Jul 21 18:16:39.143323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:16:39.143323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 could not be found. Jul 21 18:16:39.143323 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': '60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782'} Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 could not be found. Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:16:39.144127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 could not be found. Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 could not be found. Jul 21 18:16:39.145441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:16:39.146779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0e2b7e34-cb31-412c-b86b-d1182aa908fc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Returning 404 to user: Instance 60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:16:39.146779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0e2b7e34-cb31-412c-b86b-d1182aa908fc tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782" status: 404 len: 111 microversion: 2.1 time: 0.029877 Jul 21 18:16:39.146779 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 853/1724] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:16:39 2022] GET /compute/v2.1/servers/60ce6d0a-69e4-4c9a-8b90-bef3d3bb2782 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:16:39.152012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-9d5c4cae-a0c5-4f36-9708-e56c509565a2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] Calling method '.version_select at 0x7ffa2ecd4ca0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:16:39.155192 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9d5c4cae-a0c5-4f36-9708-e56c509565a2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [bcc8e8c8-9ad7-4317-8ebe-fd5292fedae5] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 18:16:40.162800 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [None req-9d5c4cae-a0c5-4f36-9708-e56c509565a2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] [bcc8e8c8-9ad7-4317-8ebe-fd5292fedae5] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 49604. Jul 21 18:16:40.180646 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-9d5c4cae-a0c5-4f36-9708-e56c509565a2 tempest-TestMinimumBasicScenario-1643140050 tempest-TestMinimumBasicScenario-1643140050-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1001665156" status: 202 len: 0 microversion: 2.1 time: 1.032305 Jul 21 18:16:40.181245 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 872/1725] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jul 21 18:16:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1001665156 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:16:48.064707 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 21 18:16:48.065160 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 18:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:16:57.478646 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=14 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:16:57.480183 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:16:57.650237 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-21efdfdf-028c-48d9-9648-6eebd3bfd2a7 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Action: 'create', calling method: .version_select at 0x7ffa2a3c0af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-475801754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIugbTOjeZ4l4iR+rxpthYTWs8aZ5O6q/Ml0XknyUVGEYIicuc1eo3ZgkKeLujL3FesxlQVaFT08F24f/e75L9zuhecV4wiNHbK7yu5X8TJEhFc8V8zrPZstaay617eXYA=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:16:57.665158 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-21efdfdf-028c-48d9-9648-6eebd3bfd2a7 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Getting quotas for project d026c3b708b4445da50aa0be2c02a8fa. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:16:57.669232 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-21efdfdf-028c-48d9-9648-6eebd3bfd2a7 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Getting quotas for user 35918feccb574b978f06f71dc01912f2 and project d026c3b708b4445da50aa0be2c02a8fa. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:16:57.692941 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-21efdfdf-028c-48d9-9648-6eebd3bfd2a7 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.220203 Jul 21 18:16:57.693534 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 854/1726] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jul 21 18:16:57 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:17:14.943722 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:17:14.944505 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:17:14.949641 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-706671520", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-475801754", "security_groups": [{"name": "tempest-secgroup-smoke-488653107"}], "networks": [{"uuid": "519214c9-7fc1-4f7c-9963-1615586c1b38"}], "block_device_mapping_v2": [{"uuid": "702ff936-8741-498f-9f91-1f4e18cc9a5c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:17:15.065538 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.network.neutron [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] validate_networks() for [('519214c9-7fc1-4f7c-9963-1615586c1b38', None, None, None, None, None)] {{(pid=124381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 18:17:15.427914 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Flavor limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 18:17:15.428376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Image limits 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 18:17:15.428862 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Flavor pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 18:17:15.429306 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Image pref 0:0:0 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 18:17:15.429725 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.virt.hardware [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 18:17:15.438621 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:15.439077 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:15.439902 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:15.440452 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:15.456897 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Getting quotas for project d026c3b708b4445da50aa0be2c02a8fa. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 18:17:15.460873 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.quota [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Getting quotas for user 35918feccb574b978f06f71dc01912f2 and project d026c3b708b4445da50aa0be2c02a8fa. Resources: {'ram', 'instances', 'cores'} {{(pid=124381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 18:17:15.516657 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Going to run 1 instances... {{(pid=124381) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 18:17:15.518963 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='702ff936-8741-498f-9f91-1f4e18cc9a5c',volume_size=None,volume_type=None)] {{(pid=124381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 18:17:15.645068 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5bab5514-a94f-4ca1-9506-cc53ade4f0e6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.702987 Jul 21 18:17:15.645699 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 873/1727] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jul 21 18:17:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 18:17:15.653666 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:17:15.654430 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:17:15.658214 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d39c91c6-0730-4553-8f26-139fb16fd3c3 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:15.659979 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d39c91c6-0730-4553-8f26-139fb16fd3c3 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:15.717072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d39c91c6-0730-4553-8f26-139fb16fd3c3 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:15.725019 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d39c91c6-0730-4553-8f26-139fb16fd3c3 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1087 microversion: 2.1 time: 0.072684 Jul 21 18:17:15.725667 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 855/1728] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:15 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:17:16.742620 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-abaab49b-05c4-4d76-ada0-bca1082ba4e0 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:16.743234 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-abaab49b-05c4-4d76-ada0-bca1082ba4e0 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:16.749381 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-abaab49b-05c4-4d76-ada0-bca1082ba4e0 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:16.749832 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-abaab49b-05c4-4d76-ada0-bca1082ba4e0 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:16.750592 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-abaab49b-05c4-4d76-ada0-bca1082ba4e0 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:16.751026 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-abaab49b-05c4-4d76-ada0-bca1082ba4e0 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:16.817364 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-abaab49b-05c4-4d76-ada0-bca1082ba4e0 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:16.825163 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-abaab49b-05c4-4d76-ada0-bca1082ba4e0 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1203 microversion: 2.1 time: 0.086835 Jul 21 18:17:16.825741 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 874/1729] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:16 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1203 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:17:17.843288 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-edeb00e2-9397-47e4-b943-f933405d9cfa tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:17.844196 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-edeb00e2-9397-47e4-b943-f933405d9cfa tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:17.851866 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-edeb00e2-9397-47e4-b943-f933405d9cfa tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:17.852528 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-edeb00e2-9397-47e4-b943-f933405d9cfa tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:17.853576 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-edeb00e2-9397-47e4-b943-f933405d9cfa tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:17.854227 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-edeb00e2-9397-47e4-b943-f933405d9cfa tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:17.994766 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-edeb00e2-9397-47e4-b943-f933405d9cfa tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:18.003761 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-edeb00e2-9397-47e4-b943-f933405d9cfa tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1258 microversion: 2.1 time: 0.163576 Jul 21 18:17:18.005003 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 856/1730] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:17 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:17:18.014853 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-ee9c7314-1a36-44e4-981a-018b770acf39 req-ab1e56b3-c08d-4c2a-a1f2-949b33d65462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96f178b-c436-47d6-b772-1eeb8cf012ca", "tag": "a1daf590-c57a-4d5c-918a-26301b55f0cf"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:17:18.025931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-ee9c7314-1a36-44e4-981a-018b770acf39 req-ab1e56b3-c08d-4c2a-a1f2-949b33d65462 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:18.026417 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-ee9c7314-1a36-44e4-981a-018b770acf39 req-ab1e56b3-c08d-4c2a-a1f2-949b33d65462 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:18.039072 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-ee9c7314-1a36-44e4-981a-018b770acf39 req-ab1e56b3-c08d-4c2a-a1f2-949b33d65462 service nova] Creating event network-changed:a1daf590-c57a-4d5c-918a-26301b55f0cf for instance b96f178b-c436-47d6-b772-1eeb8cf012ca on hv-cinder-82549 Jul 21 18:17:18.045153 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-ee9c7314-1a36-44e4-981a-018b770acf39 req-ab1e56b3-c08d-4c2a-a1f2-949b33d65462 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057647 Jul 21 18:17:18.046711 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 875/1731] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:17:19.021592 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-68af2d95-5ce8-4ed8-af01-17d9912b0cf1 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:19.022128 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-68af2d95-5ce8-4ed8-af01-17d9912b0cf1 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:19.028071 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68af2d95-5ce8-4ed8-af01-17d9912b0cf1 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:19.028555 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68af2d95-5ce8-4ed8-af01-17d9912b0cf1 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:19.029321 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68af2d95-5ce8-4ed8-af01-17d9912b0cf1 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:19.029756 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68af2d95-5ce8-4ed8-af01-17d9912b0cf1 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:19.161751 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-68af2d95-5ce8-4ed8-af01-17d9912b0cf1 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:19.169415 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-68af2d95-5ce8-4ed8-af01-17d9912b0cf1 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1258 microversion: 2.1 time: 0.151917 Jul 21 18:17:19.170025 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 857/1732] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:19 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:17:20.187012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3799d823-e28c-4ef7-aed4-a2394ec19dd6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:20.187644 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3799d823-e28c-4ef7-aed4-a2394ec19dd6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:20.194076 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3799d823-e28c-4ef7-aed4-a2394ec19dd6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:20.194529 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3799d823-e28c-4ef7-aed4-a2394ec19dd6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:20.195299 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3799d823-e28c-4ef7-aed4-a2394ec19dd6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:20.195740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3799d823-e28c-4ef7-aed4-a2394ec19dd6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:20.326185 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3799d823-e28c-4ef7-aed4-a2394ec19dd6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:20.334720 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3799d823-e28c-4ef7-aed4-a2394ec19dd6 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1258 microversion: 2.1 time: 0.152400 Jul 21 18:17:20.335292 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 876/1733] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:20 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:17:21.352009 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ada7b6df-cea9-4bd2-97cc-15d16468ebee tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:21.352585 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ada7b6df-cea9-4bd2-97cc-15d16468ebee tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:21.359127 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ada7b6df-cea9-4bd2-97cc-15d16468ebee tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:21.359581 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ada7b6df-cea9-4bd2-97cc-15d16468ebee tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:21.360373 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ada7b6df-cea9-4bd2-97cc-15d16468ebee tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:21.360819 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ada7b6df-cea9-4bd2-97cc-15d16468ebee tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:21.494533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ada7b6df-cea9-4bd2-97cc-15d16468ebee tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:21.501825 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ada7b6df-cea9-4bd2-97cc-15d16468ebee tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1258 microversion: 2.1 time: 0.153799 Jul 21 18:17:21.502389 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 858/1734] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:21 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:17:22.519485 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-63bb0214-f242-4dde-8999-f0838564b22b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:22.520101 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-63bb0214-f242-4dde-8999-f0838564b22b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:22.526598 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-63bb0214-f242-4dde-8999-f0838564b22b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:22.527050 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-63bb0214-f242-4dde-8999-f0838564b22b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:22.527816 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-63bb0214-f242-4dde-8999-f0838564b22b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:22.528255 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-63bb0214-f242-4dde-8999-f0838564b22b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:22.660081 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-63bb0214-f242-4dde-8999-f0838564b22b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:22.667769 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-63bb0214-f242-4dde-8999-f0838564b22b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1258 microversion: 2.1 time: 0.153193 Jul 21 18:17:22.668351 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 877/1735] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:22 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:17:23.685244 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f2759dc8-8365-4e08-84b8-9b8342274a40 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:23.685789 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f2759dc8-8365-4e08-84b8-9b8342274a40 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:23.692557 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2759dc8-8365-4e08-84b8-9b8342274a40 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:23.693009 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2759dc8-8365-4e08-84b8-9b8342274a40 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:23.693775 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2759dc8-8365-4e08-84b8-9b8342274a40 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:23.694213 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f2759dc8-8365-4e08-84b8-9b8342274a40 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:23.824476 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f2759dc8-8365-4e08-84b8-9b8342274a40 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:23.832497 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f2759dc8-8365-4e08-84b8-9b8342274a40 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1258 microversion: 2.1 time: 0.151184 Jul 21 18:17:23.833063 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 859/1736] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:23 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:17:24.848618 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d3369f4a-732a-40d6-97d0-3a9a663c0647 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:24.849232 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d3369f4a-732a-40d6-97d0-3a9a663c0647 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:24.855736 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d3369f4a-732a-40d6-97d0-3a9a663c0647 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:24.856179 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d3369f4a-732a-40d6-97d0-3a9a663c0647 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:24.856966 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d3369f4a-732a-40d6-97d0-3a9a663c0647 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:24.857400 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d3369f4a-732a-40d6-97d0-3a9a663c0647 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:24.996129 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d3369f4a-732a-40d6-97d0-3a9a663c0647 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:25.004408 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d3369f4a-732a-40d6-97d0-3a9a663c0647 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1258 microversion: 2.1 time: 0.159635 Jul 21 18:17:25.004996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 878/1737] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:24 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:17:26.021596 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0d39c8a8-1390-48a6-8e13-0117043f0854 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:26.022161 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0d39c8a8-1390-48a6-8e13-0117043f0854 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:26.025593 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:17:26.030109 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d39c8a8-1390-48a6-8e13-0117043f0854 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:26.030571 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d39c8a8-1390-48a6-8e13-0117043f0854 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:26.031347 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d39c8a8-1390-48a6-8e13-0117043f0854 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:26.031789 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0d39c8a8-1390-48a6-8e13-0117043f0854 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:26.158896 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0d39c8a8-1390-48a6-8e13-0117043f0854 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:26.166517 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0d39c8a8-1390-48a6-8e13-0117043f0854 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1258 microversion: 2.1 time: 0.149514 Jul 21 18:17:26.167081 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 860/1738] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:26 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:17:27.087754 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-5c84d035-0bf6-4de5-b0a2-2064dea89707 req-cecd2f0e-4c25-4591-a7f2-14947c428f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96f178b-c436-47d6-b772-1eeb8cf012ca", "name": "network-vif-plugged", "status": "completed", "tag": "a1daf590-c57a-4d5c-918a-26301b55f0cf"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:17:27.091247 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=2 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:17:27.091908 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell0:SELECT=6 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:17:27.098846 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-5c84d035-0bf6-4de5-b0a2-2064dea89707 req-cecd2f0e-4c25-4591-a7f2-14947c428f5c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:27.099299 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-5c84d035-0bf6-4de5-b0a2-2064dea89707 req-cecd2f0e-4c25-4591-a7f2-14947c428f5c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:27.113379 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-5c84d035-0bf6-4de5-b0a2-2064dea89707 req-cecd2f0e-4c25-4591-a7f2-14947c428f5c service nova] Creating event network-vif-plugged:a1daf590-c57a-4d5c-918a-26301b55f0cf for instance b96f178b-c436-47d6-b772-1eeb8cf012ca on hv-cinder-82549 Jul 21 18:17:27.118423 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-5c84d035-0bf6-4de5-b0a2-2064dea89707 req-cecd2f0e-4c25-4591-a7f2-14947c428f5c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034368 Jul 21 18:17:27.119061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 879/1739] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:17:27.183526 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e5d515cf-6234-40e2-bf5e-d3b5ae3f255c tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:27.184515 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e5d515cf-6234-40e2-bf5e-d3b5ae3f255c tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:27.193240 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e5d515cf-6234-40e2-bf5e-d3b5ae3f255c tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:27.193694 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e5d515cf-6234-40e2-bf5e-d3b5ae3f255c tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:27.194479 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e5d515cf-6234-40e2-bf5e-d3b5ae3f255c tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:27.194917 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e5d515cf-6234-40e2-bf5e-d3b5ae3f255c tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:27.341532 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e5d515cf-6234-40e2-bf5e-d3b5ae3f255c tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:27.349533 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e5d515cf-6234-40e2-bf5e-d3b5ae3f255c tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1258 microversion: 2.1 time: 0.170191 Jul 21 18:17:27.350099 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 861/1740] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:27 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:17:28.367483 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1727acd7-c938-4c1f-8eda-7c0e5a4eb891 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:28.368221 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1727acd7-c938-4c1f-8eda-7c0e5a4eb891 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:28.374564 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1727acd7-c938-4c1f-8eda-7c0e5a4eb891 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:28.375020 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1727acd7-c938-4c1f-8eda-7c0e5a4eb891 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:28.375794 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1727acd7-c938-4c1f-8eda-7c0e5a4eb891 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:28.376235 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1727acd7-c938-4c1f-8eda-7c0e5a4eb891 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:28.507854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1727acd7-c938-4c1f-8eda-7c0e5a4eb891 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:28.515369 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1727acd7-c938-4c1f-8eda-7c0e5a4eb891 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1258 microversion: 2.1 time: 0.152564 Jul 21 18:17:28.515928 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 880/1741] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:28 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:17:29.532110 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-61bc99d5-edb6-48d6-9527-15da44925316 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:29.532793 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-61bc99d5-edb6-48d6-9527-15da44925316 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:29.539420 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61bc99d5-edb6-48d6-9527-15da44925316 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:29.539862 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61bc99d5-edb6-48d6-9527-15da44925316 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:29.540910 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61bc99d5-edb6-48d6-9527-15da44925316 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:29.541340 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-61bc99d5-edb6-48d6-9527-15da44925316 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:29.674357 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-61bc99d5-edb6-48d6-9527-15da44925316 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:29.681781 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-61bc99d5-edb6-48d6-9527-15da44925316 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1442 microversion: 2.1 time: 0.153460 Jul 21 18:17:29.682370 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 862/1742] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:29 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:17:29.698224 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1d279135-cf73-4cab-a5c5-b27f86213a58 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:17:29.698867 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1d279135-cf73-4cab-a5c5-b27f86213a58 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:17:29.706002 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1d279135-cf73-4cab-a5c5-b27f86213a58 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:29.706449 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1d279135-cf73-4cab-a5c5-b27f86213a58 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:29.707211 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1d279135-cf73-4cab-a5c5-b27f86213a58 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:29.707650 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1d279135-cf73-4cab-a5c5-b27f86213a58 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:29.835598 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1d279135-cf73-4cab-a5c5-b27f86213a58 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:17:29.843053 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1d279135-cf73-4cab-a5c5-b27f86213a58 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1442 microversion: 2.1 time: 0.148613 Jul 21 18:17:29.843613 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 881/1743] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:17:29 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1442 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:17:31.770181 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-8f99a42a-e89f-4d13-953e-5c5eb53a75ae req-ed5cb369-8920-4252-b347-cb03c1ace9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96f178b-c436-47d6-b772-1eeb8cf012ca", "tag": "a1daf590-c57a-4d5c-918a-26301b55f0cf"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:17:31.778568 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8f99a42a-e89f-4d13-953e-5c5eb53a75ae req-ed5cb369-8920-4252-b347-cb03c1ace9c4 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:17:31.779015 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8f99a42a-e89f-4d13-953e-5c5eb53a75ae req-ed5cb369-8920-4252-b347-cb03c1ace9c4 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:17:31.791167 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-8f99a42a-e89f-4d13-953e-5c5eb53a75ae req-ed5cb369-8920-4252-b347-cb03c1ace9c4 service nova] Creating event network-changed:a1daf590-c57a-4d5c-918a-26301b55f0cf for instance b96f178b-c436-47d6-b772-1eeb8cf012ca on hv-cinder-82549 Jul 21 18:17:31.796119 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-8f99a42a-e89f-4d13-953e-5c5eb53a75ae req-ed5cb369-8920-4252-b347-cb03c1ace9c4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029687 Jul 21 18:17:31.796784 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 863/1744] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:19:13.944843 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jul 21 18:19:18.106996 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 21 18:19:18.107661 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 18:19:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:19:25.817421 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b71c6463-130e-4aa5-9606-3f6bbe5d89f7] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 21 18:19:25.818150 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:19:25.819162 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=42 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:19:25.824013 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-cc64bae0-e463-4057-9223-59f44537b91e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:19:25.824587 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-cc64bae0-e463-4057-9223-59f44537b91e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:25.833183 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cc64bae0-e463-4057-9223-59f44537b91e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:25.833631 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cc64bae0-e463-4057-9223-59f44537b91e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:25.834385 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cc64bae0-e463-4057-9223-59f44537b91e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:25.834819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-cc64bae0-e463-4057-9223-59f44537b91e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:25.857663 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.objects.instance [None req-cc64bae0-e463-4057-9223-59f44537b91e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lazy-loading 'flavor' on Instance uuid b96f178b-c436-47d6-b772-1eeb8cf012ca {{(pid=124381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 18:19:25.930447 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-cc64bae0-e463-4057-9223-59f44537b91e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "POST /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca/action" status: 202 len: 0 microversion: 2.1 time: 0.114599 Jul 21 18:19:25.931046 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 882/1745] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 18:19:25 2022] POST /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:19:25.939188 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR oslo.messaging._drivers.impl_rabbit [-] [769f48e3-05be-4b42-ac4d-f350afc85548] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 18:19:25.939793 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=20 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:19:25.940558 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=44 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:19:25.945580 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fc396b1d-dfe9-49b4-828e-0f70f10ec3d8 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:25.946282 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fc396b1d-dfe9-49b4-828e-0f70f10ec3d8 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:25.956826 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fc396b1d-dfe9-49b4-828e-0f70f10ec3d8 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:25.957274 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fc396b1d-dfe9-49b4-828e-0f70f10ec3d8 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:25.958041 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fc396b1d-dfe9-49b4-828e-0f70f10ec3d8 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:25.958474 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fc396b1d-dfe9-49b4-828e-0f70f10ec3d8 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:26.095473 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fc396b1d-dfe9-49b4-828e-0f70f10ec3d8 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:26.103012 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fc396b1d-dfe9-49b4-828e-0f70f10ec3d8 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.167544 Jul 21 18:19:26.103577 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 864/1746] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:25 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:27.123143 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ed3807f9-b124-45d3-a216-a5830cbbedaf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:27.123857 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ed3807f9-b124-45d3-a216-a5830cbbedaf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:27.131434 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ed3807f9-b124-45d3-a216-a5830cbbedaf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:27.131885 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ed3807f9-b124-45d3-a216-a5830cbbedaf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:27.132690 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ed3807f9-b124-45d3-a216-a5830cbbedaf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:27.133130 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ed3807f9-b124-45d3-a216-a5830cbbedaf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:27.136549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] [b71c6463-130e-4aa5-9606-3f6bbe5d89f7] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 49972. Jul 21 18:19:27.269435 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ed3807f9-b124-45d3-a216-a5830cbbedaf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:27.276893 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ed3807f9-b124-45d3-a216-a5830cbbedaf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.159115 Jul 21 18:19:27.277455 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 883/1747] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:27 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:28.295177 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-17eeaf2f-71df-4292-803f-9c8888906fe2 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:28.296440 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-17eeaf2f-71df-4292-803f-9c8888906fe2 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:28.309235 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17eeaf2f-71df-4292-803f-9c8888906fe2 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:28.309692 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17eeaf2f-71df-4292-803f-9c8888906fe2 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:28.310466 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17eeaf2f-71df-4292-803f-9c8888906fe2 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:28.310909 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-17eeaf2f-71df-4292-803f-9c8888906fe2 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:28.312105 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] [769f48e3-05be-4b42-ac4d-f350afc85548] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 49976. Jul 21 18:19:28.441226 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-17eeaf2f-71df-4292-803f-9c8888906fe2 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:28.448736 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-17eeaf2f-71df-4292-803f-9c8888906fe2 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.157843 Jul 21 18:19:28.449296 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 865/1748] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:28 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:29.466635 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-5ffc8624-3bcf-4317-8a91-71366ee66381 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:29.467394 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-5ffc8624-3bcf-4317-8a91-71366ee66381 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:29.474376 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ffc8624-3bcf-4317-8a91-71366ee66381 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:29.474833 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ffc8624-3bcf-4317-8a91-71366ee66381 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:29.475597 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ffc8624-3bcf-4317-8a91-71366ee66381 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:29.476034 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-5ffc8624-3bcf-4317-8a91-71366ee66381 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:29.609309 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-5ffc8624-3bcf-4317-8a91-71366ee66381 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:29.617576 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-5ffc8624-3bcf-4317-8a91-71366ee66381 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.154841 Jul 21 18:19:29.618138 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 884/1749] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:29 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:30.635172 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-325bb0d7-0ea5-4c40-9ed8-87959533f155 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:30.635796 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-325bb0d7-0ea5-4c40-9ed8-87959533f155 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:30.642940 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-325bb0d7-0ea5-4c40-9ed8-87959533f155 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:30.643398 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-325bb0d7-0ea5-4c40-9ed8-87959533f155 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:30.644170 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-325bb0d7-0ea5-4c40-9ed8-87959533f155 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:30.644640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-325bb0d7-0ea5-4c40-9ed8-87959533f155 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:30.774871 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-325bb0d7-0ea5-4c40-9ed8-87959533f155 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:30.783221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-325bb0d7-0ea5-4c40-9ed8-87959533f155 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.151942 Jul 21 18:19:30.783790 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 866/1750] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:30 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:31.801665 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-806876cd-da97-4c92-8689-1dce4e343064 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:31.802257 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-806876cd-da97-4c92-8689-1dce4e343064 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:31.808659 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-806876cd-da97-4c92-8689-1dce4e343064 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:31.809113 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-806876cd-da97-4c92-8689-1dce4e343064 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:31.809879 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-806876cd-da97-4c92-8689-1dce4e343064 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:31.810327 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-806876cd-da97-4c92-8689-1dce4e343064 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:31.942904 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-806876cd-da97-4c92-8689-1dce4e343064 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:31.950410 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-806876cd-da97-4c92-8689-1dce4e343064 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.153810 Jul 21 18:19:31.950977 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 885/1751] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:31 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:32.967028 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f83596f0-376c-4795-98e3-6c4519bb275b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:32.967638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f83596f0-376c-4795-98e3-6c4519bb275b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:32.974284 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f83596f0-376c-4795-98e3-6c4519bb275b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:32.974731 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f83596f0-376c-4795-98e3-6c4519bb275b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:32.975489 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f83596f0-376c-4795-98e3-6c4519bb275b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:32.975923 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f83596f0-376c-4795-98e3-6c4519bb275b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:33.108434 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f83596f0-376c-4795-98e3-6c4519bb275b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:33.116904 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f83596f0-376c-4795-98e3-6c4519bb275b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.153730 Jul 21 18:19:33.117517 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 867/1752] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:32 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:34.134706 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-feddf913-bb88-4815-81eb-92721268984d tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:34.135322 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-feddf913-bb88-4815-81eb-92721268984d tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:34.142647 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-feddf913-bb88-4815-81eb-92721268984d tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:34.143096 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-feddf913-bb88-4815-81eb-92721268984d tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:34.143857 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-feddf913-bb88-4815-81eb-92721268984d tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:34.144308 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-feddf913-bb88-4815-81eb-92721268984d tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:34.273664 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-feddf913-bb88-4815-81eb-92721268984d tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:34.281149 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-feddf913-bb88-4815-81eb-92721268984d tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.150295 Jul 21 18:19:34.281859 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 886/1753] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:34 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:35.298853 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-76a7dc12-2a1c-4043-aa8e-ca32899ddc3f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:35.299398 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-76a7dc12-2a1c-4043-aa8e-ca32899ddc3f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:35.305873 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76a7dc12-2a1c-4043-aa8e-ca32899ddc3f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:35.306321 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76a7dc12-2a1c-4043-aa8e-ca32899ddc3f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:35.307170 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76a7dc12-2a1c-4043-aa8e-ca32899ddc3f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:35.307688 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76a7dc12-2a1c-4043-aa8e-ca32899ddc3f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:35.443398 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-76a7dc12-2a1c-4043-aa8e-ca32899ddc3f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:35.452231 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-76a7dc12-2a1c-4043-aa8e-ca32899ddc3f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.157851 Jul 21 18:19:35.452827 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 868/1754] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:35 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:36.470605 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-ea86181e-306e-4527-b51f-b20531dba7c9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:36.471231 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-ea86181e-306e-4527-b51f-b20531dba7c9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:36.477946 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ea86181e-306e-4527-b51f-b20531dba7c9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:36.478333 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ea86181e-306e-4527-b51f-b20531dba7c9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:36.479109 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ea86181e-306e-4527-b51f-b20531dba7c9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:36.479549 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-ea86181e-306e-4527-b51f-b20531dba7c9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:36.611366 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-ea86181e-306e-4527-b51f-b20531dba7c9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:36.619495 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-ea86181e-306e-4527-b51f-b20531dba7c9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.153380 Jul 21 18:19:36.620061 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 887/1755] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:36 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:37.092117 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 21 18:19:37.092831 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 18:19:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:19:37.637305 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e0debc42-14f3-4a9a-8982-646e86165ecf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:37.637928 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e0debc42-14f3-4a9a-8982-646e86165ecf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:37.644998 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0debc42-14f3-4a9a-8982-646e86165ecf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:37.645456 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0debc42-14f3-4a9a-8982-646e86165ecf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:37.646221 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0debc42-14f3-4a9a-8982-646e86165ecf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:37.646667 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0debc42-14f3-4a9a-8982-646e86165ecf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:37.778547 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e0debc42-14f3-4a9a-8982-646e86165ecf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:37.786794 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e0debc42-14f3-4a9a-8982-646e86165ecf tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.153938 Jul 21 18:19:37.787359 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 869/1756] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:37 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:38.804094 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1a887c72-be78-4f46-a607-7f39910f291b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:38.804714 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-1a887c72-be78-4f46-a607-7f39910f291b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:38.811491 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a887c72-be78-4f46-a607-7f39910f291b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:38.811944 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a887c72-be78-4f46-a607-7f39910f291b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:38.812753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a887c72-be78-4f46-a607-7f39910f291b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:38.813171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-1a887c72-be78-4f46-a607-7f39910f291b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:38.950632 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-1a887c72-be78-4f46-a607-7f39910f291b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:38.958280 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1a887c72-be78-4f46-a607-7f39910f291b tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1567 microversion: 2.1 time: 0.158141 Jul 21 18:19:38.958840 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 888/1757] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:38 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:38.974427 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9c9e5cc6-02d9-4000-8573-45b8edc40425 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:19:38.975006 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9c9e5cc6-02d9-4000-8573-45b8edc40425 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:38.981620 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c9e5cc6-02d9-4000-8573-45b8edc40425 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:38.982074 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c9e5cc6-02d9-4000-8573-45b8edc40425 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:38.982897 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c9e5cc6-02d9-4000-8573-45b8edc40425 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:38.983292 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c9e5cc6-02d9-4000-8573-45b8edc40425 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:39.128755 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9c9e5cc6-02d9-4000-8573-45b8edc40425 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "POST /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca/action" status: 202 len: 0 microversion: 2.1 time: 0.158075 Jul 21 18:19:39.129667 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 870/1758] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jul 21 18:19:38 2022] POST /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:19:39.137400 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-df623728-2e40-46c2-be2b-931c1a41a83e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:39.138111 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-df623728-2e40-46c2-be2b-931c1a41a83e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:39.144396 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df623728-2e40-46c2-be2b-931c1a41a83e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:39.144951 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df623728-2e40-46c2-be2b-931c1a41a83e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:39.145753 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df623728-2e40-46c2-be2b-931c1a41a83e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:39.146181 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-df623728-2e40-46c2-be2b-931c1a41a83e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:39.316740 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-df623728-2e40-46c2-be2b-931c1a41a83e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:39.324619 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-df623728-2e40-46c2-be2b-931c1a41a83e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1515 microversion: 2.1 time: 0.191000 Jul 21 18:19:39.325197 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 889/1759] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:39 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:40.342623 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1b555aae-1ede-4b71-9ace-69432052b614 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:40.343961 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1b555aae-1ede-4b71-9ace-69432052b614 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:40.350953 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b555aae-1ede-4b71-9ace-69432052b614 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:40.351404 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b555aae-1ede-4b71-9ace-69432052b614 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:40.352183 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b555aae-1ede-4b71-9ace-69432052b614 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:40.352654 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1b555aae-1ede-4b71-9ace-69432052b614 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:40.487023 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1b555aae-1ede-4b71-9ace-69432052b614 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:40.494550 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1b555aae-1ede-4b71-9ace-69432052b614 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1517 microversion: 2.1 time: 0.156291 Jul 21 18:19:40.495107 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 871/1760] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:40 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:41.511989 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-f3209182-0f92-462f-be9f-3169a78988af tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:41.512634 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-f3209182-0f92-462f-be9f-3169a78988af tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:41.519694 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f3209182-0f92-462f-be9f-3169a78988af tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:41.520139 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f3209182-0f92-462f-be9f-3169a78988af tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:41.520926 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f3209182-0f92-462f-be9f-3169a78988af tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:41.521364 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-f3209182-0f92-462f-be9f-3169a78988af tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:41.657020 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-f3209182-0f92-462f-be9f-3169a78988af tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:41.665252 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-f3209182-0f92-462f-be9f-3169a78988af tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1573 microversion: 2.1 time: 0.157110 Jul 21 18:19:41.665819 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 890/1761] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:41 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:42.682689 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-02c42886-5298-4154-9787-e0c7a37d3bca tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:42.683313 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-02c42886-5298-4154-9787-e0c7a37d3bca tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:42.690518 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02c42886-5298-4154-9787-e0c7a37d3bca tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:42.690985 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02c42886-5298-4154-9787-e0c7a37d3bca tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:42.691761 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02c42886-5298-4154-9787-e0c7a37d3bca tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:42.692208 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02c42886-5298-4154-9787-e0c7a37d3bca tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:42.823451 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-02c42886-5298-4154-9787-e0c7a37d3bca tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:42.831031 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-02c42886-5298-4154-9787-e0c7a37d3bca tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1573 microversion: 2.1 time: 0.152167 Jul 21 18:19:42.831595 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 872/1762] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:42 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:43.750911 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [req-49cda245-a7fb-4f43-8594-fd71c074bbc1 req-de69b5db-912e-4968-8eea-f8f5d544e203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96f178b-c436-47d6-b772-1eeb8cf012ca", "name": "network-vif-unplugged", "status": "completed", "tag": "a1daf590-c57a-4d5c-918a-26301b55f0cf"}]} {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:19:43.761234 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-49cda245-a7fb-4f43-8594-fd71c074bbc1 req-de69b5db-912e-4968-8eea-f8f5d544e203 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:43.761530 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [req-49cda245-a7fb-4f43-8594-fd71c074bbc1 req-de69b5db-912e-4968-8eea-f8f5d544e203 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:43.778067 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.compute.server_external_events [req-49cda245-a7fb-4f43-8594-fd71c074bbc1 req-de69b5db-912e-4968-8eea-f8f5d544e203 service nova] Creating event network-vif-unplugged:a1daf590-c57a-4d5c-918a-26301b55f0cf for instance b96f178b-c436-47d6-b772-1eeb8cf012ca on hv-cinder-82549 Jul 21 18:19:43.783656 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [req-49cda245-a7fb-4f43-8594-fd71c074bbc1 req-de69b5db-912e-4968-8eea-f8f5d544e203 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113129 Jul 21 18:19:43.784708 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 891/1763] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:19:43.847847 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f7399b8c-c57a-409b-98f3-4eaa5d4bee1f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:43.848522 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f7399b8c-c57a-409b-98f3-4eaa5d4bee1f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:43.855028 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f7399b8c-c57a-409b-98f3-4eaa5d4bee1f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:43.855482 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f7399b8c-c57a-409b-98f3-4eaa5d4bee1f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:43.856242 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f7399b8c-c57a-409b-98f3-4eaa5d4bee1f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:43.856708 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f7399b8c-c57a-409b-98f3-4eaa5d4bee1f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:43.989964 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f7399b8c-c57a-409b-98f3-4eaa5d4bee1f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:43.997449 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f7399b8c-c57a-409b-98f3-4eaa5d4bee1f tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1573 microversion: 2.1 time: 0.153534 Jul 21 18:19:43.998015 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 873/1764] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:43 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:45.015557 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-3066f585-50c7-4780-bae0-ea4b45304769 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:45.016264 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-3066f585-50c7-4780-bae0-ea4b45304769 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:45.024245 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3066f585-50c7-4780-bae0-ea4b45304769 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:45.024755 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3066f585-50c7-4780-bae0-ea4b45304769 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:45.025519 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3066f585-50c7-4780-bae0-ea4b45304769 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:45.025957 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-3066f585-50c7-4780-bae0-ea4b45304769 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:45.155161 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-3066f585-50c7-4780-bae0-ea4b45304769 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:45.164171 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-3066f585-50c7-4780-bae0-ea4b45304769 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1573 microversion: 2.1 time: 0.152848 Jul 21 18:19:45.164763 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 892/1765] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:45 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:46.181784 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-095bf34a-b488-44eb-bb28-a4cc1c7fe5bc tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:46.182394 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-095bf34a-b488-44eb-bb28-a4cc1c7fe5bc tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:46.188945 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-095bf34a-b488-44eb-bb28-a4cc1c7fe5bc tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:46.189326 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-095bf34a-b488-44eb-bb28-a4cc1c7fe5bc tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:46.190085 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-095bf34a-b488-44eb-bb28-a4cc1c7fe5bc tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:46.191099 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-095bf34a-b488-44eb-bb28-a4cc1c7fe5bc tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:46.321458 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-095bf34a-b488-44eb-bb28-a4cc1c7fe5bc tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:46.329273 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-095bf34a-b488-44eb-bb28-a4cc1c7fe5bc tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1573 microversion: 2.1 time: 0.151629 Jul 21 18:19:46.329842 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 874/1766] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:46 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:47.347094 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-a5cd9c73-e640-4f68-80d6-b3a756ed64f9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:47.348571 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-a5cd9c73-e640-4f68-80d6-b3a756ed64f9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:47.355654 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a5cd9c73-e640-4f68-80d6-b3a756ed64f9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:47.356132 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a5cd9c73-e640-4f68-80d6-b3a756ed64f9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:47.356959 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a5cd9c73-e640-4f68-80d6-b3a756ed64f9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:47.357395 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-a5cd9c73-e640-4f68-80d6-b3a756ed64f9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:47.505398 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-a5cd9c73-e640-4f68-80d6-b3a756ed64f9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:47.512931 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-a5cd9c73-e640-4f68-80d6-b3a756ed64f9 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1573 microversion: 2.1 time: 0.169945 Jul 21 18:19:47.513505 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 893/1767] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:47 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:48.529782 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-07f1f6cb-5972-4fc6-96f0-b8123ebaab1e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:48.530412 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-07f1f6cb-5972-4fc6-96f0-b8123ebaab1e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:48.537187 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07f1f6cb-5972-4fc6-96f0-b8123ebaab1e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:48.537633 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07f1f6cb-5972-4fc6-96f0-b8123ebaab1e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:48.538392 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07f1f6cb-5972-4fc6-96f0-b8123ebaab1e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:48.538822 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07f1f6cb-5972-4fc6-96f0-b8123ebaab1e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:48.718484 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-07f1f6cb-5972-4fc6-96f0-b8123ebaab1e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:48.726504 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-07f1f6cb-5972-4fc6-96f0-b8123ebaab1e tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1573 microversion: 2.1 time: 0.200424 Jul 21 18:19:48.727163 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 875/1768] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:48 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1573 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:49.743850 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-d61ad74d-0984-4f0d-afbc-c06df7353f60 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:19:49.744518 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-d61ad74d-0984-4f0d-afbc-c06df7353f60 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:19:49.751032 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d61ad74d-0984-4f0d-afbc-c06df7353f60 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:49.751455 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d61ad74d-0984-4f0d-afbc-c06df7353f60 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:49.752206 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d61ad74d-0984-4f0d-afbc-c06df7353f60 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:49.752665 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-d61ad74d-0984-4f0d-afbc-c06df7353f60 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:49.938496 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-d61ad74d-0984-4f0d-afbc-c06df7353f60 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:19:49.946114 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-d61ad74d-0984-4f0d-afbc-c06df7353f60 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1560 microversion: 2.1 time: 0.206092 Jul 21 18:19:49.946687 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 894/1769] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:19:49 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:19:51.593606 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-be376389-1d6b-4611-a49c-225cd7adf8f0 req-148df940-94f4-41c6-96cd-2390d0ceed9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96f178b-c436-47d6-b772-1eeb8cf012ca", "name": "network-vif-plugged", "status": "completed", "tag": "a1daf590-c57a-4d5c-918a-26301b55f0cf"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:19:51.604204 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-be376389-1d6b-4611-a49c-225cd7adf8f0 req-148df940-94f4-41c6-96cd-2390d0ceed9c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:19:51.604899 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-be376389-1d6b-4611-a49c-225cd7adf8f0 req-148df940-94f4-41c6-96cd-2390d0ceed9c service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:19:51.616599 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-be376389-1d6b-4611-a49c-225cd7adf8f0 req-148df940-94f4-41c6-96cd-2390d0ceed9c service nova] Creating event network-vif-plugged:a1daf590-c57a-4d5c-918a-26301b55f0cf for instance b96f178b-c436-47d6-b772-1eeb8cf012ca on hv-cinder-82549 Jul 21 18:19:51.622968 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-be376389-1d6b-4611-a49c-225cd7adf8f0 req-148df940-94f4-41c6-96cd-2390d0ceed9c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Jul 21 18:19:51.623849 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 876/1770] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:21:00.456585 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_api:SELECT=26 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:21:00.457584 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG dbcounter [-] [124381] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:21:00.461150 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=28 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:21:00.462353 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 18:21:00.463008 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-51835c91-bfdf-446e-84a2-59b6cbd16b83 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:21:00.463862 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-51835c91-bfdf-446e-84a2-59b6cbd16b83 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:21:00.481282 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-51835c91-bfdf-446e-84a2-59b6cbd16b83 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:21:00.481730 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-51835c91-bfdf-446e-84a2-59b6cbd16b83 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:21:00.482854 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-51835c91-bfdf-446e-84a2-59b6cbd16b83 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:21:00.483295 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-51835c91-bfdf-446e-84a2-59b6cbd16b83 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:21:00.511165 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-51835c91-bfdf-446e-84a2-59b6cbd16b83 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Going to try to terminate instance {{(pid=124381) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 18:21:00.526969 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-675c3658-0454-4c8d-820d-5ce3cf1336fb req-f68a56d9-9271-4b80-8c92-c2d41fc93215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96f178b-c436-47d6-b772-1eeb8cf012ca", "tag": "a1daf590-c57a-4d5c-918a-26301b55f0cf"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:21:00.535638 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-675c3658-0454-4c8d-820d-5ce3cf1336fb req-f68a56d9-9271-4b80-8c92-c2d41fc93215 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:21:00.536091 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-675c3658-0454-4c8d-820d-5ce3cf1336fb req-f68a56d9-9271-4b80-8c92-c2d41fc93215 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:21:00.548108 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-675c3658-0454-4c8d-820d-5ce3cf1336fb req-f68a56d9-9271-4b80-8c92-c2d41fc93215 service nova] Creating event network-changed:a1daf590-c57a-4d5c-918a-26301b55f0cf for instance b96f178b-c436-47d6-b772-1eeb8cf012ca on hv-cinder-82549 Jul 21 18:21:00.554520 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-675c3658-0454-4c8d-820d-5ce3cf1336fb req-f68a56d9-9271-4b80-8c92-c2d41fc93215 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095520 Jul 21 18:21:00.555577 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 877/1771] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:21:00.614113 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-51835c91-bfdf-446e-84a2-59b6cbd16b83 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 204 len: 0 microversion: 2.1 time: 0.159184 Jul 21 18:21:00.614873 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 895/1772] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jul 21 18:21:00 2022] DELETE /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 18:21:00.624032 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-934a2237-38bc-462f-b45e-ecbe8c76bc4a tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:21:00.624768 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-934a2237-38bc-462f-b45e-ecbe8c76bc4a tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:21:00.631066 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-934a2237-38bc-462f-b45e-ecbe8c76bc4a tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:21:00.631738 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-934a2237-38bc-462f-b45e-ecbe8c76bc4a tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:21:00.632549 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-934a2237-38bc-462f-b45e-ecbe8c76bc4a tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:21:00.632985 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-934a2237-38bc-462f-b45e-ecbe8c76bc4a tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:21:00.770112 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-934a2237-38bc-462f-b45e-ecbe8c76bc4a tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:21:00.777927 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-934a2237-38bc-462f-b45e-ecbe8c76bc4a tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.158672 Jul 21 18:21:00.778503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 878/1773] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:21:00 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:21:01.796312 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-11010504-f09c-406c-b703-c82e23028e43 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:21:01.796965 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-11010504-f09c-406c-b703-c82e23028e43 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:21:01.803687 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-11010504-f09c-406c-b703-c82e23028e43 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:21:01.804206 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-11010504-f09c-406c-b703-c82e23028e43 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:21:01.805034 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-11010504-f09c-406c-b703-c82e23028e43 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:21:01.805478 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-11010504-f09c-406c-b703-c82e23028e43 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:21:01.951267 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-11010504-f09c-406c-b703-c82e23028e43 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:21:01.959064 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-11010504-f09c-406c-b703-c82e23028e43 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1566 microversion: 2.1 time: 0.167301 Jul 21 18:21:01.959626 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 896/1774] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:21:01 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 18:21:02.833897 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-d8cbf13c-d977-47c4-8745-bc91958fbefb req-bdf5998f-7cb1-45a1-8dff-24a6aced8500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96f178b-c436-47d6-b772-1eeb8cf012ca", "name": "network-vif-deleted", "tag": "a1daf590-c57a-4d5c-918a-26301b55f0cf"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 18:21:02.842492 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-d8cbf13c-d977-47c4-8745-bc91958fbefb req-bdf5998f-7cb1-45a1-8dff-24a6aced8500 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:21:02.842941 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-d8cbf13c-d977-47c4-8745-bc91958fbefb req-bdf5998f-7cb1-45a1-8dff-24a6aced8500 service nova] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:21:02.856371 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-d8cbf13c-d977-47c4-8745-bc91958fbefb req-bdf5998f-7cb1-45a1-8dff-24a6aced8500 service nova] Creating event network-vif-deleted:a1daf590-c57a-4d5c-918a-26301b55f0cf for instance b96f178b-c436-47d6-b772-1eeb8cf012ca on hv-cinder-82549 Jul 21 18:21:02.861511 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-d8cbf13c-d977-47c4-8745-bc91958fbefb req-bdf5998f-7cb1-45a1-8dff-24a6aced8500 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091025 Jul 21 18:21:02.862647 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 879/1775] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jul 21 18:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 18:21:02.976474 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-959ecde9-9555-4278-8783-f807c31ff602 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:21:02.977012 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.compute.api [None req-959ecde9-9555-4278-8783-f807c31ff602 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124381) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:21:02.984276 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-959ecde9-9555-4278-8783-f807c31ff602 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:21:02.984848 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-959ecde9-9555-4278-8783-f807c31ff602 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:21:02.985556 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-959ecde9-9555-4278-8783-f807c31ff602 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:21:02.985998 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG oslo_concurrency.lockutils [None req-959ecde9-9555-4278-8783-f807c31ff602 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:21:03.048472 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.policy [None req-959ecde9-9555-4278-8783-f807c31ff602 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35918feccb574b978f06f71dc01912f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd026c3b708b4445da50aa0be2c02a8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124381) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 18:21:03.058007 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-959ecde9-9555-4278-8783-f807c31ff602 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 200 len: 1218 microversion: 2.1 time: 0.084624 Jul 21 18:21:03.058917 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 897/1776] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:21:02 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 18:21:04.076640 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-971fff1f-8dfb-40dc-95af-2b38e081c768 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:21:04.077935 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-971fff1f-8dfb-40dc-95af-2b38e081c768 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] [instance: b96f178b-c436-47d6-b772-1eeb8cf012ca] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 18:21:04.085072 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-971fff1f-8dfb-40dc-95af-2b38e081c768 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:21:04.085527 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-971fff1f-8dfb-40dc-95af-2b38e081c768 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:21:04.086292 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-971fff1f-8dfb-40dc-95af-2b38e081c768 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 18:21:04.086731 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-971fff1f-8dfb-40dc-95af-2b38e081c768 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Lock "d906d140-42ad-4012-a7e5-1433e18e34ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 18:21:04.100278 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-971fff1f-8dfb-40dc-95af-2b38e081c768 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] HTTP exception thrown: Instance b96f178b-c436-47d6-b772-1eeb8cf012ca could not be found. Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-971fff1f-8dfb-40dc-95af-2b38e081c768 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Request method failure captured: Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca HTTP/1.1 Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept: application/json Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Connection: close Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Host: 10.222.0.57 Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABi2ZgUJgHi2IKjfQaSjBEzaz0RdNsAwSOfJCFuEn0heUViBRcnw88BH_b9GDPybmhrfNAM5DBp_bTxuR176HUbdMYhXrkheJlEaTBTUrMu25_E05EH3LwA0ZIX-YTf0Lxmjk4fF_sXx862B3LxMznVUy5B-j6q5AaCSenmAFjAaaUDBNA Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Id: d026c3b708b4445da50aa0be2c02a8fa Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestShelveInstance-1874341038 Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jul 21 18:21:04.101900 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jul 21 18:21:04.103431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d026c3b708b4445da50aa0be2c02a8fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d026c3b708b4445da50aa0be2c02a8fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d026c3b708b4445da50aa0be2c02a8fa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d026c3b708b4445da50aa0be2c02a8fa"}]}] Jul 21 18:21:04.103431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestShelveInstance-1874341038 Jul 21 18:21:04.103431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Id: d026c3b708b4445da50aa0be2c02a8fa Jul 21 18:21:04.103431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestShelveInstance-1874341038 Jul 21 18:21:04.103431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User: tempest-TestShelveInstance-1874341038-project Jul 21 18:21:04.103431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jul 21 18:21:04.103431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jul 21 18:21:04.103431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Id: 35918feccb574b978f06f71dc01912f2 Jul 21 18:21:04.103431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestShelveInstance-1874341038-project Jul 21 18:21:04.103431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: method: > Jul 21 18:21:04.103431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: exception: Instance b96f178b-c436-47d6-b772-1eeb8cf012ca could not be found. Jul 21 18:21:04.103431 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: action_args: {'id': 'b96f178b-c436-47d6-b772-1eeb8cf012ca'} Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96f178b-c436-47d6-b772-1eeb8cf012ca could not be found. Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 18:21:04.104607 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96f178b-c436-47d6-b772-1eeb8cf012ca could not be found. Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96f178b-c436-47d6-b772-1eeb8cf012ca could not be found. Jul 21 18:21:04.106132 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jul 21 18:21:04.107503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-971fff1f-8dfb-40dc-95af-2b38e081c768 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Returning 404 to user: Instance b96f178b-c436-47d6-b772-1eeb8cf012ca could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 18:21:04.107503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-971fff1f-8dfb-40dc-95af-2b38e081c768 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca" status: 404 len: 111 microversion: 2.1 time: 0.032001 Jul 21 18:21:04.107503 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 880/1777] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jul 21 18:21:04 2022] GET /compute/v2.1/servers/b96f178b-c436-47d6-b772-1eeb8cf012ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 18:21:04.264065 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: DEBUG nova.api.openstack.wsgi [None req-1b83e21c-c38d-40eb-baf9-d01f89581231 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] Calling method '.version_select at 0x7ffa2a4a7ca0>' {{(pid=124381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 18:21:04.285234 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO nova.api.openstack.requestlog [None req-1b83e21c-c38d-40eb-baf9-d01f89581231 tempest-TestShelveInstance-1874341038 tempest-TestShelveInstance-1874341038-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-475801754" status: 202 len: 0 microversion: 2.1 time: 0.025352 Jul 21 18:21:04.286121 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: [pid: 124381|app: 0|req: 898/1778] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jul 21 18:21:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-475801754 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 18:21:35.887441 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 18:21:35.888017 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 18:21:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:21:48.075211 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 21 18:21:48.075858 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 18:21:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:24:13.949306 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 18:24:13.949815 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 18:24:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:24:18.115361 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 18:24:18.115945 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 18:24:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:24:31.603103 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 18:24:31.603659 dv-cinder-825492-27-iscsi devstack@n-api.service[124381]: Thu Jul 21 18:24:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 18:24:37.100968 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 18:24:37.101714 dv-cinder-825492-27-iscsi devstack@n-api.service[124380]: Thu Jul 21 18:24:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!